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Abstract 



The paper analyzes a Lagrangian system which is controlled by directly assigning some 

of the coordinates as functions of time, by means of frictionless constraints. In a natural 

system of coordinates, the equations of motions contain terms which are linear or quadratic 

w.r.t. time derivatives of the control functions. After reviewing the basic equations, we 

^ I explain the significance of the quadratic terms, related to geodesies orthogonal to a given 

^^ ■ foliation. We then study the problem of stabilization of the system to a given point, by 

I^ I means of oscillating controls. This problem is first reduced to the weak stability for a 

f^ ■ related convex-valued differential inclusion, then studied by Lyapunov functions methods. 

l' I In the last sections, we illustrate the results by means of various mechanical examples. 
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A mechanical system can be controlled in two fundamentally different ways. In a commonly 
C^ I adopted framework [?, ?], the controller modifies the time evolution of the system by applying 

additional forces. This leads to a control problem in standard form, where the time derivatives 
of the state variables depend continuously on the control function. 

In other situations, also physically realistic, the controller acts on the system by directly 
assigning the values of some of the coordinates, by means of time dependent constraints. The 
evolution of the remaining coordinates can then be determined by solving an "impulsive" 
control system, where the derivatives of the state variables depend (linearly or quadratically) 
on the time derivative of the control function. This alternative point of view was introduced, 
independently, in [?] and in [?]. 

Motivated by this second approach, in the present paper we study the following problem of 
Classical Mechanics: 

Consider a system where the state space is a product QxU of finite- dimensional m^anifolds 
Q and U. Assume that one can prescribe the motion t i-^ u(f) £ U of the second component, 
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A mechanical system can be controlled in two fundamentally different ways. In a commonly 
C^ I adopted framework [11, 21], the controller modifies the time evolution of the system by ap- 

plying additional forces. This leads to a control problem in standard form, where the time 
derivatives of the state variables depend continuously on the control function. 

In other situations, also physically realistic, the controller acts on the system by directly 
assigning the values of some of the coordinates, by means of time dependent constraints. The 
evolution of the remaining coordinates can then be determined by solving an "impulsive" 
control system, where the derivatives of the state variables depend (linearly or quadratically) 
on the time derivative of the control function. This alternative point of view was introduced, 
independently, in [8] and in [19]. 

Motivated by this second approach, in the present paper we study the following problem of 
Classical Mechanics: 

Consider a system where the state space is a product QxU of finite- dimensional m^anifolds 
Q and U. Assume that one can prescribe the motion t i-^ u(f) £ U of the second component, 



by means of frictionless constraints. Given a point (q, u), can one stabilize the system at this 
point, by an oscillatory motion of the control u(-) around u ? 

A well known example where stability is obtained by vibration is provided by a pendulum 
whose suspension point can oscillate on a vertical guide, as in Figure 1, left. Calling 9 the 
angle and h the height of the pivot, in this case we have (q, u) = {9,h) G S^ x I. Here 
S^ = [0, 27r] with endpoints identified, and / is an open interval. If we take q = ^ = as the 
(unstable) upper vertical position of the pendulum, it is well-known (see for example [1, 14, 15] 
and references therein) that this configuration can be made stable by rapidly oscillating the 
pivot around a given value u = h. More generally, we will show that this system can be 
asymptotically stabilized at any angle 6 with —tt/2 < 9 < tt/2, by a suitable choice of the 
control function t i-^ h{t) = u{t). 





Figure 1: Left: a pendulum with vertically moving pivot and fixed length. Right: a pendulum 
with fixed pivot and variable length. 

On the other hand, consider the variable length pendulum, where the pivot is fixed at the 
origin, but we can assign the radius of oscillation r as function of time, see Figure 1, right. The 
system is again described by two coordinates (q, u) = (9, r) G S*^ x /. However, in this case, 
the upright equilibrium position is not stabilizable by any oscillatory motion of the radius r(t) 
around a fixed value. 

A major difference between these two systems is that the equation of motion of the first 
one contains a quadratic term in the time derivative u = du/dt. On the other hand, the 
equation for the variable-length pendulum is affine w.r.t. the variable u. Actually, the explicit 
dependence on u can be here entirely removed by a suitable change of coordinates. 

To understand the general problem, one has to consider two main issues. The former is 
geometric, and involves the orthogonal curvature of the foliation 



A = {Qx{u}, ueu}. 



(1.1) 



Orthogonality is here defined w.r.t. the Riemannian metric determined by the kinetic energy. 
The orthogonal curvature is a measure of how a geodesic, which is perpendicular to the leaf 
Q X {u} of the foliation at a given point (q, u), fails to remain perpendicular to the other 
leaves it meets. If this curvature is non-zero, then the dynamic equations for q and for the 
corresponding momentum p contain a quadratic term in the time derivative u of the control 
function. This will be analyzed in detail in Part I, Sections 5, 6. 

The latter issue is analytical, namely: how to exploit this curvature, i.e. the quadratic terms 



in u, in in order to achieve stabilization. This will be discussed in Part II of this paper. In 
particular, we study the set of solutions for a system with quadratic, unbounded, controls, 
making essential use of reparametrization techniques. These, in turn, are combined with 
arguments involving Lyapunov functions for a convexified system. 

The paper consists of three parts. In order to keep our exposition as self-contained as possible, 
in Part I we first describe the mechanical model and derive the basic dynamical equations. In 
Section 2 we recall the classical equations of motion, in a Hamiltonian intrinsic form, for time- 
dependent holonomic systems subject to non-conservative forces. Although this is a classical 
subject, which can be found in many text-books in Classical Mechanics, the purpose of this 
first section is to clarify concepts and notations used in the remainder of the paper. In Section 3 
we consider a state space y = QxlA given by the product of two manifolds. The controls will 
be curves t i-^ u(t) taking values in the manifold U. The main physical assumption we are 
making is that these controls u(-) are implemented by means of frictionless, time-dependent 
constraints. One can then derive the equations of motion on the reduced state space Q, 
where the dynamics depends on u and on its time derivative li, the latter dependence being 
polynomial of degree two. In Section 4, we deduce the local expression of the control equations 
in a system of local coordinates adapted to the foliation A in (1.1). Section 5 contains a survey 
of some geometrical and functional analytic results concerning the input-output map and the 
kinetic metric. The main new result of Part I appears in Section 6, where we present a new 
interpretation of the quadratic dependence of the equations of motion on the derivative of the 
control functions. Our characterization of the quadratic coefficients is given in terms of the 
concatenation of two geodesies, the second returning to the same leaf of the foliation where 
the first one had started. This generalizes to higher dimensions a result in [16], where the 
scalar control case is considered. Finally, Section 7 provides a variational characterization of 
admissible control-trajectory pairs. 

In Part II we consider a general nonlinear system where the right hand side is a quadratic 
polynomial w.r.t. the time derivatives of the control function. 

m m 

X = f{x) + ^ga{x)Ua+ ^ K,p{x)UaUfi. (1.2) 

Q=l a,l3=l 

Using a re-parametrization technique, we show that the stabilization problem for the impul- 
sive control system (1.2) can be reduced to proving a weak stability property for a related 
differential inclusion with compact, convex- valued right hand side: 

^x(s)GF(x(s)), (1.3) 

{mm m 

f{x)wl + ^go,{x)wQWa+ ^ ha,i3{x)waWi3 ; Woe [0,1], ^wl = l 
a=l a,l3=l a=0 

where W denotes a closed convex hull. Theorems 9.1 and 9.2 relate the weak (asymptotic) 
stabilizability of the differential inclusion (1.3) with the (asymptotic) stabilizability of the 
impulsive control system (1.2). 

In practical cases, a direct analysis of the multifunction F may be difficult. In Section 9, in 
addition to (1.3) we thus consider an auxiliary differential inclusion of the form x G G{x), 
where the multifunction G is derived from (1.2) by neglecting all linear terms, i.e. by formally 



setting Qa = 0. We show that the weak stabihty of this second differential inclusion still yields 
the relevant stabilization properties for the original control system (1.2). Motivated by [29], in 
Section 10 we also show that the weak stability of the differential inclusion can be established 
by looking at suitable selections. 

In Part III we apply the previous analytic results to the problem of stabilization of mechanical 
systems, controlled by moving holonomic constraints. Thanks to the particular structure of 
the quadratic terms that appear in the equations of motion, we show that in many cases one 
can construct a suitable Lyapunov function, and thus establish the desired stability properties. 
The paper is then concluded with some examples, presented in Section 12. 

Throughout the paper, our focus is on systems in general form, where the equations of motion 
depend quadratically on the time derivatives iia ■ In the special case where the dependence 
is only linear, i.e. h^,^ = in (1.2), our results still apply; however, controllability and 
stabilization are best studied by looking at Lie brackets of the vector fields /, ga, using standard 
techniques of geometric control theory [13, 32]. 

In addition to [8, 19], readers interested in the earlier developments of the theory of control of 
mechanical systems by moving constraints are referred to [9, 12, 10, 22, 23]. A concise survey, 
also outlining possible applications to swim- like motion in fluids, has recently appeared in [3]. 
See also the lecture notes in [25]. 



Part I 

Time-dependent holonomic constraints as 
controls 

2 Review of the dynamical equations on the cotangent bundle 

The Legendre-Fenchel transform 

Let VF be a finite-dimensional, real vector space, let W* be its dual space, and let ( , ) denote 
the duality between W and W*. For every map L : W ^^ M, its Legendre-Fenchel transform 
is defined as 

L*(P)= sup{(P,V)-L(V)}, (2.1) 

for every P G W*. L* is a convex map. If L is strictly convex, then L* is strictly convex, and 
{L*y = L. 

In the special case where L is the sum of a positive definite quadratic form and an affine 
function, the same is true of its transform L* . Moreover, the following facts are well-known: 

• For every P G W* there exists a unique V = i (P) G W where the maximum on the 

right-hand side of (2.1) is achieved. The map i^ : W* ^^ W is one-to-one, affine, and 
satisfies 

(i^)-i = ii*. (2.2) 



If L is a quadratic form then i^ and i^* are linear. 

• By identifying both W and W* with JR" (by the choice of a basis on W and of the dual 

basis on W*) and using ^ and ^p- to denote the gradients of L and L*, respectively, 

one has 

f)r* r)T 

^^(P) = |^(P) (^'^)~'(V) = ^^*(V) = —(V) . 

HOLONOMIC MECHANICAL SYSTEMS 

Let 3^ be a d-dimensional manifold, and call Ty = {Ty-, y G 3^}, T*y = {T*; y G 3^} its 
tangent and cotangent bundles. If W C 3^ is an open subset, and Y -.W ^^ M'^ is a coordinate 
chart, we recall that the corresponding bundle charts (Y, V) and (Y, P) on Ty and T*y, are 
obtained by choosing the local frames I -^ ; \ <r < d\ and {dYj. ; 1 < r < d}, respectively. 

By a holonomic mechanical system with d degrees of freedom defined on a time interval I C M 
we mean a pair S = {y,T), where: 

• 3^ is a d-dimensional manifold; 

• T : Z X Ty h^ M is a map, called the kinetic energy of the system S, such that T = 
% + Ti+T2„ with 

'ro(t,y,V) = igo(t,y), ri(t,y,V) = (gi(i,y),V), 

(2.3) 
r2(t,y,V) = ig2(t,y)(V,V). 

In (2.3), the gj are smooth maps defined on / x 3^. For each (t,y), the map g2(i, y) is a 
positive-definite quadratic form, gi{t,y) is linear map, while goitjy) is a constant. 

We say that the system S = {y,T) is time-independent if gi(t, y) = 0, go(i,y) = for all 
(t, y) G X X 3^, and g2 is independent of t. Equivalently, T = T^ and does not depend on 
time. In the frame-work of Lagrangian mechanics, this means that the holonomic constraints 
determining the system S are time-independent. In this case, the notion of mechanical system 
coincides with that of Riemannian manifold, endowed with the metric g2. 

In terms of a local bundle chart (y, y) on Ty , the maps in (2.3) take the form 

ro(t,y,y) = ^5o, Tx{t,Y,V)=grV\ T2{t,Y,V) = ]^grsV'V\ (2.4) 

Here the d x d matrix {gr,s), the row vector {gr), and the real number gQ are the coordinate 
representations of g2(i,y), §1(^5 y), and go{t,y), respectively. Here and in the sequel, it is 
understood that a summation should be performed over repeated indices. 

Let us define the map T* : / x T*y h^ M as the Legendre transform of T. For every 
(t, y) £ I X y, this means 

r*(i,y,P)= sup {(P,V)-r(t,y,V)}. 
Similarly, we define 7J as the Legendre transform of 72 • 



The maps T* and T2 will be also called the kinetic Hamiltonians corresponding to T and T2, 
respectively. Accordingly, we shall use the notation 

n = T* 7^2 = To*. 



As in (2.2), for every (t, y) G / x 3^ we have the afHne isomorphisms ijy : T*y h^ Tyy and 

i;:Tyy^T;: 



ijt ■■ Tyy ^ T*y, defined as 



il^ = int,y,-) and i^; = i^*(t,yr) . (2.5) 

T T* 

respectively. Entirely similar linear isomorphisms i^y and i^y can be defined in connection 

with the quadratic map T2 . According to (2.2), for all (t,y) & I x y one has 

''t,yj ~ 't,y \''t,y) - ''t,y 

Using coordinates, if we use {g'^'^) to denote the inverse of the dx d matrix {gr,s) in (2-4), then 



-1 



the affine isomorphisms i/y and i/y = [iiyj are given by 

V' = ily{Pi,...,Pa) = g'''%Pr-gr) s = l,...,d, (2.6) 

Ps = ily{V\ . . . ,V'') = gr,sV'- + gs s = l,...,d. (2.7) 

By the identity 

T /'D^\ '-rl-^ ,, aT 



n{t,y,P) = T*(t,y,P) = {P,ily{P))-r[t,y,ily{P 

it straightforward to check that the Hamiltonian can be decomposed into a constant, a linear, 
and a quadratic part. Namely, 7i = TCq + TCi + 7^2 with 



n2it,y,P) = -g^(t,y)(P,P) = -g2(t,y) <|,(P), <|,(P) , 



2° ^ '"'^ ' ' 2 



Hi(t,y,P) = g^(t,y)(P) = -(gi(t,y), ig,(P)) 



1 0'- ^ 1 



Wo(t,y) = ^s'\t,y) = -[g'(t,y)(gi(t,y),gi(t,y)j-go(t,y 
We remark that, by our assumptions, the quadratic form g^(t,y) is positive definite. 

Using local coordinates (Y, P) the decomposition of the Hamiltonian function takes the form 
n{t, Y, P)=no + ni + n2, where 

Ho = ^/'^<7rffs-f, n, = -g'''Prgs, n2 = \g'^'PrPs. (2.8) 

Symplectic structure 



Consider again the d-diniensional manifold y. By ujy we shall denote the canonical sym- 
plectic form on T*y. This is the (nondegenerate) 2-form which, in any chart of y and the 
corresponding bundle chart of T*y, is represented by the constant 2d x 2d symplectic matrix 




For each (y, P) G T*y, by means of the canonical symplectic form uy one can establish a 
linear isomorphism Sy^p : T*p{T*y) h^ Ty^p{T*y). This is uniquely defined by setting 



(/3,w)=..y(y,P)(sy,p(/3),wj. (2.9) 

With reference to coordinates {Y, P) , if /? = {(3rdY^ + jrdPr), one has 

Sy,p(/3) =lrT^7TZ-Pr 



For every function (j) : I x T*y i-^ M, differentiable w.r.t. the second variable for every t £ I, 
one can define a time-dependent vector field X^ on T*y, called the Hamiltonian vector field 
associated to 0. For each (t,y, P) G / x T*y, this is defined by 

X^(t,y,P) = Sy,p(d,^(t,y,P)) 

where d(j){t, •) denotes the differential of the map (f){t, •) : T*y h^ ]R. In local coordinates, one 

has 

dcj) d d(j) d 

^^ dPr dVr ~ dV dPr ' 



Forces 

Forces are represented by vertical vector fields on the cotangent bundle T*y. We recall that, 
for (y,P) G T*y, a vector X G r(y^p)(T*3^) is called vertical if 

dU{y,F){X) = 0. 

Here H : T*y h^ y is the canonical projection of T*y on y and (in(y , P) denotes its differential 
at (y,P). The subspace of vertical vectors at (y, P) is thus the kernel of the map dn(y, P). 
It will be called the vertical tangent space of T*y at (y, P) and denoted by Vty^-p\{T*y). 
The corresponding fiber sub-bundle of T(T*y) is called the vertical tangent bundle of T*y 
and denoted by V{T*y). 

A vector field F on (r*3^) is said to be vertical if F(y , P) G V(y,p) {T*y) for each (y, P) G T*y. 
Using a canonical bundle chart of T*y, a vertical vector field is thus represented by a 2d- 
dimensional column vector of the form (0, . . . , 0, Fi, . . . , Fd), where the superscript ' denotes 
transposition. 

More generally, let / be a real interval. A function F : / x T*y h^ V{T*y) such that, for 
each t £ I, the map F(t, •) is a vertical vector field on T*y will be called a time- dependent 

7 



vertical vector field. In order to retain its physical meaning, F will also be called a (possibly 
time-dependent) force acting on y during the time-interval /. 

A time-independent force F is called positional if F(y, P) = F(y), i.e. if its values depend only 
on y and not on the value P G Ty . Furthermore, a positional force F is called conservative 
if there exists a potential function U : y ^^ M such that F is the Hamiltonian vector field 
corresponding to U, namely 

F = Xu. (2.10) 

Recalling the symplectic form toy in (2.9), we now introduce a formal notion of power of the 
force F, which will play an important role in Section 3. Let (y,P) G T*y, F G V(yp)(T*3^), 
and V G T{T*y). The quantity 

u;y{F,V) (2.11) 

will be called the power of F with respect to V. If (Y, P) are canonical local coordinates on 
T*y and 

then one obtains the familiar expression for the power: 

LOyiF , V) = FrVr . 



The equation of motion 

Let S = {y,T) be a mechanical system and let 7i be the corresponding kinetic Hamiltonian. 
Let F be a force acting on 3^. Then the equation of motion for the mechanical system S 
subject to the force F is the differential equation 

^(^]=Xn + F tel, {y,P) eT*y, (2.12) 

where Xy^ is the Hamiltonian vector field associated to 7i. 

If F is a conservative force with potential function U : y ^^ M, we can consider the standard 
Hamiltonian 

H = {T-U)* , 

defined as the Legendre transform of T — [/. Then (2.12) reduces to the usual Hamiltonian 
form 

i(l)=x„ t,r. (2.13) 

Indeed, one has Xn + Xu = Xn+u andTi + U = {T - U)* = H . 

With the usual notational conventions, the equation of motion (2.12) in a local bundle chart 
takes the form 



A>r dH 



p dH _i_ 77 



l,...,d. (2.14) 



(2.15) 



(2.16) 




(2.17) 



Using the expressions (2.8) for the Hamiltonian, from (2.14) we obtain 

Pr = -^ {hegs - Pi9s + iPiPs) + g'' ^ {Pi - gi) + ^ + Fr . 
In the case of a time-independent system, these equations reduce to 

¥'■ = g^'-'Ps , 
p — 1 9g*° p p I p 
In particular, if the force is conservative, (2.16) takes the familiar Hamiltonian form 

dH_ ( — „r,s p \ 

( - _l9a!lp^p _ d^) 
3 Time-dependent constraints as controls 

In this section we shall set up the general framework to treat the situation where additional 
time-dependent holonomic constraints are regarded as controls. 

3.1 Structural assumptions 

We shall consider a mechanical system T, = {y, T) verifying the following assumptions: 

1) (Product structure). The state manifold 3^ is a product manifold, namely 

y = QxU, (3.1) 

Here Q and U, called the reduced state space and the control space, are manifolds of 
dimension N and M, respectively. 

2) (Stationarity of the metric)^ The Lagrangian system S is time-independent. Namely, 
the kinetic energy T is defined by a triple g = (g2, 0, 0) with g2 independent of time. 

3) (Regularity of the force). The external force F = F(t,q, u, P,p) is a function 
measurable w.r.t. t and locally Lipschitz w.r.t. all other variables. 

By (3.1), one has the natural identifications of r*(Qx^Y), T{T*{QxU)), and V{T*{QxU)) 
with the products T*{Q) x T*{U), T{T*{Q)) x T{T*{U)), and V{T*{Q)) x V{T*{U)), 
respectively. 



^This assumption is made only for the sake of simplification, since it avoids a double time-dependence: the 
structural one and the one due to the implementation of controls. Actually, the situation where g has a general 
form can be treated as well without significative additional difficulties. 



By the second assumption, T = 72, and, for every (t,y) £ I x y, the affine isomorphism 
i^ = iy is a hnear isomorphism, independent of time. In turn the Hamiltonian is time- 
independent and its global and local expressions are given by 

H(y,P) = ^g-i(y)(P,P) 



, N+M 



and 

n{Y,P) = ^ Y: g''%Y)Pr.Ps , 
r,s=l 

respectively. Moreover, for each y G 3^, as soon as the vector spaces Tyy and T*y are endowed 
with the scalar products defined by g(y) and g^^(y), respectively, the isomorphism li is an 
isometry. In particular, one has 

r(y,iJ(P))=W(y,P) 

for ah y G 3^ and P G T*y. 

We observe that, for every (q, u) £ Q xU, the map tl^ can be naturally split in two compo- 
nents. Indeed, for (p, p) £ T^Q x T^U, we can write 

iluiP,P) = ((ilu)^{P,p),(iluTiP,P)) G T^QxTJA. (3.2) 



3.2 Foliation structure and adapted coordinates 

The product structure of 3^ = Q x ^ induces a foliation structure, where the set of leaves is 

A = {Qx{u} vi£U} . (3.3) 

For every (q, u) £ QxU, we denote by A(q, u) = Q x {u} the leaf through (q, u). Let us 
consider the corresponding distribution^ A, whose fibers are given by 

A(q,u) = T^Q X {0}. 
In our analysis, a very important role will also be played by the orthogonal distribution 

Afq,u) = {y^ T^Q X TuU I g(q, u)(y, X) = for aU X G A(q,,)}, (3.4) 

also called the orthogonal bundle, for short. 

In connection with the foliation A at (3.3), we say that a system of coordinates {q,u) is A- 
adapted if the sets {u = constant} locally coincide with the leaves of the foliation. Of course, 
the local product coordinates {q, u) are A-adapted. More generally, if (q, u) are A-adapted, 
then every system of coordinates {q, u) obtained from [q, u) by means of a local diffeomorphism 
of the form 

q = q{q,u) u = u{u). (3.5) 

is A-adapted as well. 



^In our context, the term "distribution" is meant in the sense of differential geometry, namely, a fiber 
sub-bundle of the tangent bundle T[Q x U). 

10 



3.3 Admissible input-output pairs 

Consider a control function t >-^ u(t) G U. In this section we characterize the corresponding 
output t H^ (q(i)) p(^)) as the solution of a certain Cauchy problem. In the following section, 
we then show that our definition is consistent with the mechanical model, where the control 
is implemented in terms of frictionless constraints. 

For every (u, w) G TU , let us define the map T"''^ : TQ h^ Mhy setting 

r"'-(q,v)=T(q,u,v,w), (3.6) 

for all (q, v) G TQ. This map can be regarded as the kinetic energy of the reduced system 
when the control takes the value u, with ii = w. 

Let / C iR be an interval, and let u : / i-^ W be an absolutely continuous control. The (time- 
dependent) kinetic energy of the reduced system on Q, corresponding to the control u(-) is 
described, almost every t £ I and for all (q, v) G TQ, by 

(t,q,v)^r"W'"W(q,v). 

The corresponding (time-dependent) Hamiltonian on T*Q is 

(t,q,p)^W"W'"W(q,P), 

where 

H"'-(q,p)= sup {(p,v)-T"'-(q,v)}. (3.7) 

Since g is positive definite, for every (q, u) G Q x U and every p G T* Q, the affine function 
in (3.2) is invertible. Its inverse will be denoted by 

W^ P(q,u,p)(w). 

Let {q,u) be A-adapted coordinates, and let (g, n,p, tt) are the corresponding bundle coordi- 
nates. Let {Fi, F/v+a) be the components of the force F, so that 

F = Fij- + FN+aj— . (3.8) 

OPi d-Ka 

Recalling the dimensions of the manifolds Q and U, we here have i = 1,...,N and a = 
1, . . . ,M. The Einstein summation convention is always used. In addition, we set 

dpi 

Notice that Fq is independent of the chosen A-adapted system of coordinates. For every 
(u, w) G TU and i = 1, . . . , A^, we also define 

-^"''^(i,q,p) = ^i(i,q,u,p,p(q^u^p)(w)) (3.10) 

and 

uw d 

FQ'^(t,q,p) = i^s(i,q,u,p,p(q,u,p)(w)) = -Fj(t,q,u,p, p(q^u^p)(w))— . (3.11) 
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Remark 3.1 Despite (3.6), in general one has 

W"'"^ (q, p) / w (q, u, p, p(q,u,p) (w)) . 

The actual relation between these two functions will be illustrated in Lemma 4.1. 

Definition 3.1 Let I C JR be a time interval. Let 

u:I^U (q, p):I^r*Q 



be absolutely continuous maps. We say that (u(-), (q, p)(-)) is an admissible input-output 
pair if (q, p) is a Caratheodory solution of the control equation of motion 

|(q(t), p(t)) =X^„„)..w(q(t),p(t)) +F^W'"(*)(q(t),p(t)) . (3.12) 

Here X-^u,u denotes the Hamiltonian vector field corresponding to H"'", with respect to the 
symplectic structure on T*Q. 

We recall that a Caratheodory solutions of an ODE x = f{t, x) is an absolutely continuous 
function 1 1-^ x(t) that satisfies the differential equation at a.e. time t. Given an initial data 

(q(t),p(t)) = (q,p) , (3.13) 

and an absolutely continuous control function t h^ u(t), the existence and uniqueness of a 
corresponding admissible output (q(-), p(-)) can be obtained from standard ODE theory. 

Depending on the geometrical properties of the metric g, the regularity assumptions on the 
input u and the output (q, p) can be considerably weakened. This fact, discussed later on in 
the paper, is essential for both optimization and stabilization purposes. 



3.4 Realization of controls as frictionless constraints. 

To motivate the previous notion of input-output pair, we need to recall the notion oi frictionless 
constraint reaction in the Hamiltonian framework. 

Let Pri : T*{Q) x T*{U) -^ T*{Q) denote the canonical projection on the first factor, and, 
for every ((q, p), (u, p)) £ T*{Q) x T*{U), let D(Pri)(q, p, u, p) denote its derivative. 

Let us consider the subspace of vertical vectors 

^S,p),(u,p) = (^{q,p)(^*2)x^(u,p)(r*^))nker(i?(Pri)(q,p,u,p)). 
It is straightforward to verify that 

^g,p),(u,p)={0}x^(u,p)(™)- 

Definition 3.2 The subspace Rf -, , -, will be called the subspace of Q-frictionless reactions 
at ((q, p), (u, p)). The corresponding vector bundle based on T*Q x T*U will be called the 
vector bundle of Q-frictionless reactions. 
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Remark 3.2 In terms of the canonical form ujy on 3^ = QxU, R9- ^n / -, can be characterized 
as the subspace of V(q p) (T* Q) x V(u p) (T*U) made of those vectors ^ such that 

ujy{<^, V)=0 for all V G T^^^p){T*Q) x {0} (3.14) 

We remind that, in the language of symplectic geometry, $ and V are also said anti- orthogonal. 

Remark 3.3 We are here regarding the constraint reactions as a set-valued force, described 
by the multifunction 

(q,p),(u,p) ^-R(q,p),(u,p)- 

To check that this definition coincides with the usual one it is sufficient to notice that if 
<& G ^^p,u,p ^ii*^ ^ — Z]r=i *^^gp" i^ its local expression, then (3.14) is equivalent to 

(($l,...,$Ar,$7V+l,...,$Ar+M) , (i-i, . . . , ^TV, 0, . . . , 0)) =0 for ah Vi, . . . ,vn ^ IR. 

Of course, this holds if and only if $j = for all i = 1, . . . , A^. 

Definition 3.1 is justified by Theorem 3.1 below. Let / C K be an interval, and, for every 
(t, q, u, p, p) G / X T*Q X T*U -^ T*Q, let us set 

X^it, q, u, p, p) = D{Pri) ■ Xnit, q, u, p, p). 

Notice that, according to (3.11), 

FQ{t, q, u, p, p) = D{Pri) ■ F{t, q, u, p, p). 



Theorem 3.1 Consider a time interval I C M and let the maps u : I ^^ U , (q, p) : 

I h^ T*Q be twice continuously differentiable. Then the following conditions are equivalent: 



(i) (u(-), (q(-))P("))) ^^ ^'^ admissible input- output pair, that is, (q, p) verifies 

|(q(t), p(t)) =X„.(,)..w(q(t),p(t)) +F^W'"W(q(t),p(t)) . (3.15) 



(ii) The path (q(-))P(")) ^-^ '^^ integral curve of the control system 



-(q(t),p(t)) = [xS(t,q(t),u(t),p(t),p)+FQ(t,q(t),u(t),p(t),p) 



l*==«'(q(t),u(t),p(t))("W) 

(3.16) 



(iii) There exist selections 

t ^ Pit) G T:^,^iU) t ^ r{t) G <(,),p(,),,(,),p(,) 

such that, for all t £ I, one has 

^ (q(t), u(t), p(t) , Pit)) =Xn+F + r{t) . (3.17) 

The map r(-) in (3.17) is called the constraint reaction corresponding to the motion (q, p, u, p){- 
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Proof. Assume that condition (iii) holds. In particular, for every t £ I, one has 



which implies 



Therefore 



pit) = P(q(t),u(t),p(t))(u(t)). 



|(q(t),p(t)) = i?(Pri).^(q(t),u(t),p(t),p(t)) = D{Pri) ■ [Xn + F + r{t) 
= X2(q(t), u(t), p(t), p{t)) + FQ(q(t), u(t), p(t), p(t)) 
X2(q(t), u(t), p(t), p) + FQ(q(t), u(t), p(t), p) 



ls==P{q{t),u(t).p(t))("(*)) 



Hence (ii) holds as well. 



Conversely, let us show that (ii) implies condition (iii) . If (q(-))P(")) i^ ^ solution of (3.16), 
then, setting 

P(t) = P{q(t),u(t),p(t))(u(t)), 

one has 



u 



which coincides with the equation for the variable u in (3.17). Therefore, condition (iii) is 
satisfied provided that we define 

r{t) = p{t)-Xn{ci{t),u{t),p{t),p{t))-F{q{t),u{t),p{t),p{t)). 



In order to prove that conditions (i) and (ii) are equivalent, it is sufficient to prove that the 
right-hand sides of the involved equations do coincide. Actually, recalling the definition of 
Fq'"" at (3.11), for all ((q,p), (u, w)) eT*Qx T*U, one has 



-^s(*,q,u,p,p) 



l*= = *=(q,u,p)(«') 



F"'- q,p . 



Hence the proof is concluded as soon as one proves the identity 



X^^u.w q, p 



^^(q,u,p,p) 

lp=P(q,u,p)(«') 

This will be done in Section 4 — see Lemma 4.1 below — by use of of local coordinates 



(3.18) 



D 
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4 The control equation in local coordinates 

Consider a A-adapted coordinate chart {q, u) defined on an open set U, and let ( (q, u), {p, w 
be the corresponding coordinates on the fiber bundle 

U {(q,u)}x(T*Qxru^). 

(q,u)eC/ 

Let G = {gr,s)r,s=i,...,N+M be the matrix representing the kinetic metric g, and let G~^ = 
ig^'^)r,s=i,...,N+M denote its inverse. In the following, we consider the sub-matrices 

Gi = {g^,,) , G2 = {gN+a,N+p) , {G-% = (5^+".^+/5) , 

with the convention that the Latin indices i,j run from 1 to N, while the Greek indices a,f3 
run from 1 to M. For convenience, we also define 

yl= (a*'^-) = {Gi)-\ E={e^^p) = {{G-%)-\ K = {k},^J = {G'^^E . (4.1) 

Let u(-) : I ^^Uhe twice continuously differentiable, and let (q, p) : / h^ T*Q be a curve such 
that (u(-) , (q, p)(-)) is an admissible input-output pair for the control equation of motion. 

By possibly restricting the size of the interval /, we can assume that (q(t),u(t)j remains 
inside the domain of the single chart (g, u) for every t £ I. 

Theorem 4.1 Given an admissible input-output pair, the corresponding coordinate maps t >-^ 
u{t) , I },{ j j satisfy the differential equation 



Ap 



-irita^. 



/ Kii 



+ 



+ + • (4.2) 



,tdKi, U.tm,; T?OM-) 



Pj \-2P'^P ) \-P'^^ ) V2^'W^/ \Pq 

In addition, recalling (3.10)-(3.11), 

^«(.),«(-) ^ fpu{-)M-)^ _ _ . ,f;(-^'"(-)). (4.3) 



For convenience, in (4.2) we write all vectors as column vectors, while the superscript ^ denotes 
transposition. Componentwise, this means: 

(4.4) 
P^= -h'-^PiP, - #P,n" + i%#n"n/5 + i^""'"". 

(where i runs from 1 to N). 



15 



Proof. Let 7^"'"^ be the local coordinate representation of the Hamiltonian Ti^'"" . Then the 
map {q,p){-) satisfies the system 






(4.5) 



Using the expression of the kinetic energy 

j-u^w ^ l^q'^Giq + q^Gi2W + ]^w^ G2W 
in terms of the given coordinates, we obtain 

7^«--(g,p) = ■Hl''"{q,p)+nl''"{q,p)+nl'"{q,p) , (4.6) 

where 

nnq,p) = IpHGi)-'p, Hr('?,P) = -pHG^r'G^2W, 

nriQ,P) = ^w^GUGir^Guw - ^w^G2W. 



The theorem can thus be proved by checking that 

n''''"{q, u) = ]-p^Ap + p'^Kw - ]-w^Ew . (4.7) 

From the identity 

Gi(G-i)i2 + Gi2(G-i)2 = 

one obtains 

= Gr'Gi(G-i)i2^ + G:,^Gi2{G-%E, 

which implies 

[k = ) {G-\2E = -{Gi)-^Gi2 = -AGi2- (4.8) 

Moreover, from (4.8) and the identity 

lM = G^2iG )l2 + G2{G )2 , 

one gets 

E = Gl2(G-i)i2^ + G2{G-^)2E = -GI^AGu + G2 . (4.9) 

Together, (4.8) and (4.9) yield (4.7), concluding the proof. D 

We conclude this section by proving the following lemma, which was used in the proof of 
Theorem 3.1. 

Lemma 4.1 For all ((q, p), (u, w)) G T*Q x TU one has 

x^{<i,'^,p,p) I =^w"'-(q,p) (4.10) 
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Proof. Since the thesis is local one can use coordinates to prove it. Consider a A- adapted 
coordinate chart (q, u) and let ( {q, u), {p, w)]( {q, u), {p, p) j be the corresponding coordinates 
on the fiber bundles T*QxTU and T*Qx T*U, respectively. Let (G"^)i2, A, E, K have the 
same meaning as before. Moreover, let us set ((G~^)i = {g^'-')i,j=i,...,N- We have to prove that 



and 



where 



^H"'"' _ dn 
dp dp 

dq ~ dq\^^ 



l*==«'(g,n,p)("') 



(4.11) 



(4.12) 



P(g,M,p)M =w'^E+p^K. 



t R . ^t , 



In fact, by (4.6) one has 



dp 
On the other hand, one can easily check that 

an 



--p'^A + Kw. (4.13) 



dp \ I , 

SO (4.11) is proved. 



■ p 



(G-i)i + {G-%2 {w^E + p^K) = p^A + Kw, (4.14) 



To prove (4.12), let us consider the well-known identities 

^e that the map p i-^ 
letting 



Observe that the map p ^^ ^ ' {q,p) is the inverse of the map v i-^ ^ ' {q,v). Hence, 



^={iZu) {p,{ilu) (^^'^ 



one obtains 



dn, , an, 

ar , , ar , , aw"'"', , 

so (4.12) is proved as well. D 
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Remark 4.1 As a matter of fact, one could show that Lemma 4.1 is vahd under the weaker 
assumption that T is strictly convex in the velocity (v, w) — see [25]. 



5 The Riemannian structure and and the input-output map 

The presence of the derivative u in the dynamic equations (4.2) depends on the Riemannian 
metric g defining the kinetic energy and on the foliation A at (3.3). In this section we review 
the main results in this direction. To simplify the discussion, throughout this section we shall 
assume that the additional forces F vanish identically, so that in (4.3) one has 

The following definitions were introduced in [8]. 

Definition 5.1 A local, A-adapted, system of coordinates {q,u) on Q x U is called N-iit for 
hyperimpulses if, for every difjerentiable control function u(-), the right-hand side 

of the corresponding equation of motion (4-4) does not contains any quadratic term in the 
variable ii. 

A local, A-adapted, system of coordinates (q, u) on QxU is called strongly A^-fit for hyperim- 
pulses if, for every difjerentiable control function u(-), right-hand side of (4-4) ^^ independent 
of the variable u. 

Moreover, we shall call generic any local , A-adapted, system of coordinates (q, u) which is not 
N-fit for hyperimpulses. 

Remark 5.1 The denomination ^^N -fit for hyperimpulses'^ for a system of coordinates {q^u) 
refers to the fact that, if the dependence on ii is only linear, one can then construct solutions 
[q{-),p{-)] also for discontinuous controls u{-). In general, a jump in u{-) will produce a 
discontinuity in both components q{-) and p{-). For this reason we call it a hyperimpulse, as 
opposite to impulse, which can cause a discontinuity in the component p(-) only. 

A first characterization of A-fit coordinates was derived in [8]. It is important to observe 
that the property of being A-fit depends only on the metric g and on the foliation A, not on 
particular the system of A-adapted coordinates. This leads to 

Definition 5.2 [23] The foliation A is called A-fit for hyperimpulses if there exists an atlas 
of A-adapted charts that are also N-fit for hyperimpulses. In this case, all A-adapted charts 
are then N-fit for hyperimpulses. 

The foliation A is called strongly A-fit for hyper- impulses if there exists an atlas of A-adapted 
charts which are strongly N-fit for hyper-impulses. 

Moreover, the foliation A will be called generic if it is not N-fit for hyper-impulses. 
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The paper [23] established the connection between the A^-fitness of the fohation A and the 
bundle-hke property of the metric, introduced in [27, 28]. We recall here the main definitions 
and results. 

Definition 5.3 The metric g is bundle-like with respect to the foliation A if, for every A- 
adapted chart, it has a local representation of the form 

N M 

Yl 9i,j{Q, u)^' 0uj^ + Y^ 9N+a,N+i3{q, u)dc" dc^ , 

i,j=l a, 13=1 

where uj^,... ,uj^ are linearly independent l-forms such that, for each (q, u) G Q x U in the 
domain of the chart, one has 

(i) (aj"'^(q, u), . . . , cj (q, u), dc'^iu), . . . , dc (u) j is a basis of the cotangent space T*Qx T*l/(; 
(ii) ^a;*(q,u),y^ = 0, for every Y G A^^^^^. 

We recall that Af ^^n is the orthogonal bundle, defined at (3.4). If g is bundle-like with 
respect to the foliation A, the latter is also called a Riemannian foliation^ because in this case 
a Riemannian structure can be well defined also on the quotient space. In order to state the 
next theorem, we recall the notion of completely integrable distribution. (Here, by distribution 
we mean a map that maps 

Definition 5.4 Let y be a manifold of dimension d, and let T be a distribution on y of 
dimension N < d. (I.e., for every y £ M, T{y) is a subspace of dimension N of Tyy.) 
We say that the distribution T is completely integrable if, for every y £ y, there exists a 
neighborhood Uofy and a local system of coordinates {x, z) = (x^, . . . , x^ , z^~^^ , . . . , z'^) such 
that at each point y £ U one has 

{ d 
Fy = span < — — i = 1.,. . . ,N 
Voxi 

Tiieorem 5.1 On the product space y = Q xU, consider the natural foliation A as in (3.3). 
The following statements are equivalent: 

i) The foliation A is N-fit for hyper-impulses. 

ii) The metric g is bundle-like with respect to the foliation A, i.e., the foliation A is Rieman- 
nian. 

Hi) For any u, ii G ^ the map (iu,u(") '. Q^^ JR defined by 

du{<i} = dist [{q, u), Q x {u}^ 
is constant. In other words, leaves remain at the same distance from each other. 

iv) If t H^ (q(t), u(i)) is any geodesic curve with respect to the metric g, and i/ (q(T), u(r)) G 
^(qfr) u(t)) at some time t , i/ien (q(t), u(t)) £ Af .^n /^-.n /or a// 1. In other words, if a geodesic 
crosses perpendicularly one of the leaves, then it crosses perpendicularly also every other leaf 
which it meets. 
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v) If (q, u) is a A-adapted system of coordinates, then 

Q N+a,N+l3 



dqi 



i = l,...,N, a,p = l,...,M, (5.1) 



where G ^ = {g"^'^) denotes the inverse of the matrix G = ((/r,s) representing the metric g in 
the coordinates {q, u) . 

Indeed, the equivalence of i) and ii) is a trivial consequence of the definitions of bundle-like 
metric and of iV-fit system of coordinates. The equivalence of ii), iii), and iv), is a classical 
result on bundle-like metrics [27]. Moreover, by (4.4), the foliation is fit for jumps if and only 
if dca^is/dq^ = 0. Recalling that the matrix (e„^^) is the inverse of {G^'^)2 = (^^+"'^+'^), we 
conclude that i) is equivalent to v). 

Theorem 5.2 The following statements are equivalent: 

i) The foliation A is strongly N-fit for hyperimpulses . 

ii) The foliation A is N-fit for hyperimpulses and the orthogonal bundle Af ^n in (3.4) is 
integrable. 

iii) There is an atlas such that, for every chart {q,u), one has 

-^—— = 0, 5*'^+° = for all i = l,...,N, a,/3 = 1, . . . , M. 

oqt 

Indeed the equivalence of i) and ii), formulated in terms of Riemannian foliations, was proved 
in [27]. The equivalence between i) and iii) follows from (4.4). See again [27] and [23] for 
details. 



6 The quadratic term in the control equation and the orthog- 
onal curvature of the foliation A 

As we have seen in the previous section, the A^-fitness for hyperimpulses of a coordinate 
system (q, u) can be characterized in terms of geodesies. Indeed, the quadratic terms in the 
control equation of motion (4.4) are identically zero if and only if any geodesic which crosses 
perpendicularly one leaf of the foliation A also has perpendicular intersection with every other 
leaf it meets. 

In the general case, however, the quadratic terms in (4.4) do not vanish. We wish to give here 
a geometric interpretation of these terms. This will again be achieved by looking at geodesies 
whose tangent vector initially lies in the orthogonal distribution A-*-. 

6.1 W-orthonormal coordinates 

We shall make an essential use of a Proposition 6.1 below, which establishes the existence of a 
special kind of A-adapted charts. To state it, let us set (x^, . . . , x^+^) = {q^, . . . , q^ , u^, . . . , u^), 
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and, for every h,k,r,s = 1, . . . ,N + M, let us consider the functions 

1 fdgh,r , dgh,s dgr,s\ ^k ^ kh ( ^9^'"' , clg^'" 



-L h,r,s — o a™e "T fl„». fl™;, ^r,s — y «„.« "r 



2 V 9a;'' dx'' dx^ J r,s y ^ ^^^ Q^r g^h 

The r^j, are the well-known Christoffel symbols. 

Proposition 6.1 Consider a point (q, u) £ QxU and an orthonormal basis { Ji, . . . , Jm} of 
A-'-(q, u). Then there exist A- adapted coordinates {q,u), defined on a neighborhood o/(q, u), 
such that calling G = {gr,s)r,s=i,...,N+M the corresponding kinetic matrix, one has 

(i) the point (q, u) has coordinates (0,0); 

(ii) gr,siO, 0) = g^'^{0, 0) = 5r,s (the Kronecker symbol) for all r,s = 1, . . . ,N + M ; 

(iii) for every w = {wi, . . . , wm) G 1R , the geodesic {q, u)uj{-) issuing from (q, u) with velocity 
equal to wiJi + . . . wm-Jm has local representation (q, u)w{t) = (0, . . . , 0, twi, . . . , twM) ■ 

Moreover, for all indices i = 1, . . . ,N and a, (3,^ = 1, . . . , M, we have 

^i,N+a,N+l3iO, 0) = r^+Q,Ar+/3(0, 0) = 0, TN+y,N+a,N+l3{0, 0) = ^N+l,N+t3(^^ 0) = (6.1) 

In turn, this implies 

a N+l3,N+'y fjfji,N+l3 /)n«'^+7 

A chart with the above properties will be ca//erf ZY-orthonormal at (q, u). 

Proof. We start by considering A-adapted coordinates {q,u), defined on a neighborhood of 
the point (q, u), such that at the point (q, u) one has {q,u) = (0,0) and 

d 

Ja, a = 1,... ,M, 



9u" 
while 



|j; = = l....,iV 



is an orthonormal basis of the tangent space TQ at (q, u), w.r.t. the metric g. 

To achieve the further property (iii), we need to modify these coordinates, using the exponen- 
tial map. In the following, given a tangent vector V G T'(q,u)(2 ^^)i we denote by r i-^ 7v(''") 
the geodesic curve starting from (q, u) with velocity V. In other words, 

7v(0) = (q,ii), ^(0)=V. 

The exponential map is then defined by setting 

i?a;p(q,fl)(V)=7v(l). 
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This is well defined for all vectors V in a neighborhood of the origin. 



Denote by f^, iij(q, u) the coordinates of a point (q, u) via the chart {q,u). We now define 
{q, u) to be the new coordinates of a point (q, u) provided that 

/ M \ 

[q,u){ci,u) = [q,u) ( ^xp(q,fl) ( ^ n"J,) j + (g\ . . . , g^, 0, . . . , 0). (6.4) 

Notice that this is well defined, for all (q, u) in a neighborhood of (q, u). Indeed, the map 
p : ]R^+^ ^ 1R^+^ defined by 

/ M \ 

p{q\...,q'',u\...,u'') = [q,u) ( fep(q,Q) ( J] n" J„) j + ((?\ . . . , g^, 0, . . . , 0). (6.5) 

maps the origin into itself. Moreover, by the properties of the chart {q,u), the Jacobian 
matrix dp/d{q^ , . . . ,q^ ,v} , . . . ,u^) at the origin coincides with the identity matrix. This 
already establishes the properties (i)-(ii). 

By construction, {q, u)(q, u) = (0, . . . , 0, u^, . . . , u ) if and only if 

M 
(q, u) = -Ea;p(q u) ( ^ n%) . 

Q = l 

This establishes (iii). 

In order to prove (6.2)-(6.3), we observe that the geodesic curves correspond to solutions of 
the second order equations 

iji = Tl,qiq' + IVi^^J^ii'' + T^^^^^^^u'^u^ i=l,...,N 

(6.6) 
ilf = rl,<m' + 2Tl^^J^u- + Tl^^^^^^ii^u^ 7 = 1, • • • , M 

By the previous construction, for any given w G M^ the solution of (6.6) with initial data 

{q,u,q,u){0) = {0,0,0,w) (6.7) 

satisfies 

q{t) = 0, u{t) = tw. (6.8) 

By (6.6) we obtain 

= g^O) =rV+„,^+^(0,0)t/;"u;/5 



= n7(0) =Tl_^^,,_^^(0,0)w-w' 



Since these equalities hold for all initial data w G M^ in (6.7), this and property (ii) prove 
(6.1). 



Now, by 



- ri^N+a,N+(s[0, 0) - —Q-:^ [0, 0) + g^p (0, 0) —. (0, 0) 
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we obtain 6.2, since, by property (ii), one has 

for alH = 1, . . . , A^ and a, /3 = 1, . . . , M. 
Moreover, for every a, /3, 7 = 1, . . . , M, one has 

dgN+a,N+/3 ^ , ^ „ 
-K-^ = i N+a,N+-f,N+p + -L Af+/3,Ar+7,Ar+a = U, 

SO that, in view of property (ii), (6.3) is proved as well. D 

Remark 6.1 As in (4.1), we can now define {ea,^)a,i3=i,...,M as the inverse of the sub-matrix 
{g'^~^°''^~^^)a,i3=i,...,M- Then, since at {q,u) = (0,0) we have gr^s = 5^'* = Sr,s, it follows 

^(0,0) = ^^^+y+^ 0,0) foran ^ = 1,...,A^, a,/3 = 1, . . . ,M . (6.9) 



6.2 The orthogonal curvature of the fohation 

For any (q, u) in the range of a A-adapted chart, consider the quantity 

^^ dc"" dc^ ^ dq' (6.10) 

Lemma 6.1 The function in (6.10) is intrinsically defined with respect to the foliation A. 
This means that if (g, u) is a A-adapted chart then 



dca 13 dv? du^ dq^ de. 



7,(5 



dq^ du" dul^ dq^ dq^ 



(6.11) 



Proof. Since(g, u) and (q, H) are A-adapted, the coordinate transformation (q, u) h^ (g, u) 
satisfies ^ = 0. Therefore, 

dui du^ 
By inverting the matrices on both sides of the above identity one obtains 

which implies (6.11), because u = u{u) is independent of q. D 



23 



Although the quantity in (6.10) is not a tensor in the strict sense of the word, by (6.11) it stih 
transforms hke a tensor w.r.t. to changes of A-adapted coordinates. Hence, it is intrinsicahy 
defined in terms of the fohation. By a shght abuse of language, we thus define (6.10) as the 
orthogonal curvature tensor of the foliation A. 

According to Theorem 5.1, the foliation A is A^-fit for hyperimpulses if and only if the the 
corresponding orthogonal curvature is identically equal to zero. We now give a geometric 
construction which clarifies the meaning of the coefficients dea^p/dq^ in (6.10), in the general 
case (see Figure 2). 

Fix any point (q, u) G Q xlA and consider any non-zero vector V G Af ^-, . Construct the 
geodesic curve that originates at (q, u) with speed V, namely 

SH^7v(s) = -Ea;p(q^u)(sV). (6.12) 

Next, for each s 7^ 0, consider the orthogonal space Af ^ % at the point (qs,U5) = 7v(s). 
Assuming that s is sufficiently small, a transversality argument yields the existence of a unique 
vector W € Af „ ^ such that 

^a:p(q,,p,)W = (q„u) G Q X {u} . (6.13) 

In other words, we are moving back to a point (g^, u) on the original leaf Q x {u}, following 
a second geodesic curve. In general, q^ 7^ q. We claim that, setting o" = s^, the map 

cr ^ (q^?, u) 

defines a unique tangent vector Z(V) G ^(q,u) • Moreover, the map V h^ Z(V) is a homoge- 
neous quadratic map from Af ^n into the tangent space T(qu)Q C T'(qu-)(Q xU). In turn, 
this determines a unique symmetric bilinear mapping B : Aj- ^n Aj- . h^ ^(q,u) Q such that 
B(V,V) =Z(V), namely 

5(Vi, V2) = ^Z(Vi + V2) - ^Z(Vi - V2) . (6.14) 

The relation between the bilinear mapping (6.14) and the curvature tensor (6.10) can be 
best analyzed by using coordinates. Consider an orthonormal basis (Ji, . . . , Jm) of A-'-(q, u), 
together with local Z//-orthonormal coordinates {q,u), constructed as in Proposition 6.1. If 
V = wi Ji + • • • + wm-Jm, then by construction the point (q^, Ug) has coordinates (0, sw) = 
(0, . . . , 0, swi, . . . , swm)- Let (^to(s), 0) be the coordinates of the point (qs, u), constructed as 
in (6.13). We now have: 

Theorem 6.1 The curve s \-^ qw{s) G iR^ is continuous and satisfies 

M 



..... , ^-y^w'^w'^ i = l,...,N. (6.15) 

a,fi=l 



lim 



Proof. It is understood that the coefficients dca^is/dq^ in (6.15) are computed at (g, u) = (0, 0), 
corresponding to the point (q, u). In view of (6.9), it suffices to prove that 

lim ^ = i y ^g^+"..^+/3 ^^^/3. (6.16) 

^-0 s2 2 V, dq' ^ ' 
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Figure 2: The geodesies involved in the computation of the orthogonal curvature of A. 

In coordinates, the geodesic a i-^ 7w(f) = Exp(^^^^^^-^{a'W) is given by a map a i-^ (g(o-), u(cr)) 
which, for suitable adjoint variables p = (pi, . . . ,PAf), vr = (vri, . . . , ttm), satisfies the Hamilto- 
nian system 



q' = g^'^Pj + 9 



i,N+P 



T^I3 



^a ^ gN+a,jp^ ^ gN+a,N+p^^ 



Pi 



T^n 



■2-d^P3Pk-^%^Pj^P 



2 a^^^ ^/3'^7 



(6.17) 






The conditions 7w(0) = (qs,U5), 7w(l) G Q x {u}, and the fact that W G Af ^ n imply 

p^{0) = 0. (6.18) 



(?*(0) = 0, 

u"(0) = SliJo 

u°(l) = 0. 



For s sufficiently small, the existence and uniqueness of the solution to the two-point boundary 
value problem (6.17)-(6.18) follows from the implicit function theorem. We now seek an 
expansion of this solution in powers of s. 



Call vr = '7r(0), and consider the Cauchy problem for (6.17), with initial data 



(7(0) =0, 
u{0) = sw , 



p(0) = 0, 
7r(0) = 7f. 



(6.19) 



Using the Landau order symbols, our computations can be simplified by observing that 

for ah a £ [0, 1] . (6.20) 



q{a) = 0{s^) 
p{a) = 0{s^) 



u{a) = Ois), 
7Tia) = Ois), 
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For all a £ [0, 1], the solution of the Cauchy problem (6.17), (6.19) thus satisfies 



Q'i<^) 



Pi{t)dt+ / /^+%(t)dt + o(s2) 

Jo 



u°'{a) = SW+ TTa{t) dt + o{s^) , 
Jo 



Pi{<y) 



1 dg^+P-^ 



Af+7 



2 dq^ 



-(0,0)- / T^B{t)TTM)dt + o{s^) 

Jo 



From the second and fourth estimates in (6.21) we deduce 

tt"(cr) = SWa + CTTta + o{s ) . 

Since u"(l) = 0, this implies 

TTq, = —SWa + o{s ) . 

Using this additional information in the third estimate, we obtain 

Pi(.(^) = "2 Q~i ("^'0) ■a-s^Wi3W^ + o{s'^), 

In turn, the first estimate now yields 



Q\l) 



„2 r. N+f3,N+^, 



-{0,0) wpw^ 



4 5g' 
Recalling the identity (6.2), we thus obtain 



2 du-i 



-(0, 0) WfsWy + o{s 



q\s) = q\l) 



,2 o Ar+/3,7V+7 



2 ag* 

In view of property (ii), this establishes (6.16). 



-(0,0) Wj3W^ + o{s ) . 



(6.21) 



D 



7 A variational characterization of input-output pairs 

Let the system S be subject to conservative forces generated by a potential U : Q x U >-^ M 
of class U^. The Lagrangian of the system (S, g) subject to the potential U is defined as 

iL(q,v,u,w)=r(q,u,v,w)+f/(q,u) ((q, v), (u, w)) G TQ X ™. (7.1) 

Moreover, for a given (u, w) G T^, we define the {u,w) -Lagrangian iL"''^ by setting 

iL"'-(q,v)=iL(q,v,u,w) (q, v) G TQ . 

Let the corresponding (u,w)-Hamiltonian be defined by 

i?^-'P(q,v) = (X"'-)* (q,p) = sup {(p, v) - iL"'-(q, v)} (q, p) G T*Q. 

veTqQ 

We now show that the admissible input-output pairs, introduced in Definition 3.1, can be 
characterized by a variational principle. 
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Theorem 7.1 Assume that the Lagrangian takes the form (7.1). Let u^ : [a,b] ^^ U he a 
continuously differentiable control, and let t h^ (u''(t) , (q'(t), p'(i)) be an admissible input- 
output pair, so that (3.12) holds. Then q^{-) provides a stationary point to the integral func- 
tional 

T|f/]„(,)= riL"'W'"«W(q(t),q(t))dt. (7.2) 

' J a 

among all maps q{-) in the admissible set 

^ = -^ q : [a, 6] H^ Q ; q{-) is absolutely continuous, q(a) = q (o), q{b) = q (&) \ ■ 
In this case, the control equation of motion has a fully Hamiltonian form, namely 

(q(t), p(t)) = X^^w.uw (q(t), p(t)) (7.3) 

Proof. It is straightforward to check that the control equation of motion (3.12) coincides with 
the Hamiltonian system (7.3). In turn, this is equivalent to the Euler-Lagrange equations for 
the integrand in (7.2). Hence, a solution of (3.12) provides a stationary point to the integral 
functional (7.2). D 

Remark 7.1 Since the kinetic energy is strictly positive definite, the trajectory q*'{-) provides 
a local minimizer. More precisely, there exists 5 > such that the following holds. For every 
subinterval [r, r'] C [o, h] such that r' — r < (5, one has 

25g(,»)=^rmn^2t;g(,), 

where the minimization is taken over the set 

Ary = -^ q : [r, r'] H^ Q ; q{-) is absolutely continuous, q(T) = q'(r), ?(t') = q'(T') > . 

Part II 

Quadratic control systems and 
stabilizability 

8 Trajectories of controlled systems with quadratic impulses 

We now investigate general control systems of the form: 

m m 

x = fix) + J29c.ix)u''+ J2 KA^)u''u^- (8-1) 

a=l a,f3=l 

Here the state variable x and the control variable u take values in iR" and in JR^, respectively. 
We remark that no a priori bounds are imposed on the derivative ii. Our main goal is 
to understand under which conditions the system can be stabilized to a given point x. In 
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particular, relying on the quadratic dependence on ii of the right-hand side of (8.1), in Section 
10 we shall investigate vibrational stabilization, achieved by means of small periodic oscillations 
of the control function. In Part III, these results will be applied to the stabilization of the 
mechanical systems discussed in Part I. 

Throughout the following we assume that the functions f,ga, and ha,^ = hp^a are at least 
twice continuously differentiable. We remark that the more general system 



f{t,x,u) + ^ga{t,x,u)u°' + Y^ K,i3{t, 

a=\ a,/3=l 



X, U) if^iJ^ . 



where the vector fields depend also on time and on the control u, can be easily rewritten in the 
form (8.1). Indeed, it suffices to work in the extended state space x G iR-'^"''""'"™', introducing 
the additional state variables x° = t and x„+a = u" , with equations 



^0 



X = 1 , Xn+a = It" a = 1, . . . , m . 



Given the initial condition 

x(0) = x, (8.2) 

for every smooth control function u : [0, T] h^ iR"^ one obtains a unique solution t h^ x(t; u) 
of the Cauchy problem (8.1)-(8.2). More generally, since the equation (8.1) is quadratic 
w.r.t. the derivative u, it is natural to consider admissible controls in a set of absolutely 
continuous functions n(-) with derivatives in L^. For example, for a given i^ > 0, one could 
allow the controls to belong to 

{n : [0, T] ^ iR™ ; / |u(t)|2 dt < k} . (8.3) 

The main goal of the following analysis is to provide a characterization of the closure of this 
set of trajectories, in terms of an auxiliary differential inclusion. Let us notice that the system 
(8.1) is naturally connected with the differential inclusion 

X G T{x), (8.4) 

where, for every x G iR"^, 

{ra ra | 

/(x) + 5]<7a(a;)w;"+ E V/3W^"^''; (u;\...,t^'")GiR™ L (8.5) 
Q!=l a,/3=l J 

Here and in the sequel, for any given subset A of a topological vector space, lioA denotes the 
closed convex hull of A. 

In addition, it will be convenient to work also in an extended state space, using the variable 



X = ( ) G iR^"^". For a given x, consider the set 



^ a— 1 ^ ^ a,/3— 1 ^ ''"^ -^ Q— 

(8.6) 
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Notice that F is a convex, compact valued multifunction on 1R^^^\ Lipschitz continuous 
w.r.t. the Hausdorff metric [2]. 

For a given interval [0, S], the set of trajectories of the graph differential inclusion 

^^x{s) e F{x{s)) , ^(0) = (^°) (8-7) 

is a non-empty, closed, bounded subset of C([0,S'] ; iR^"*""). Consider one particular solution, 
say s h^ x{s) = i ^ x ) , defined for s £ [0, S]. Assume that T = x^{S) > 0. Since the map 
s 1-^ x^{s) is non-decreasing, it admits a generalized inverse 

s = s{t) iff x^{s) = t. (8.8) 

Indeed, for all but countably many times t £ [0,T] there exists a unique value of the parameter 
s such that the identity on the right of (8.8) holds. We can thus define a corresponding 
trajectory 

t ^ x{t) = x{s{t)) G iR". (8.9) 

This map is well defined for almost all times t £ [0,T]. 

To establish a connection between the original control system (8.1) and the differential inclu- 
sion (8.7), consider first a smooth control function n(-). As in [26], we define a reparametrized 
time variable by setting 



rt 



(8.10) 



Notice that the map t i-^ s{t) is strictly increasing. The inverse map s i-^ t{s) is uniformly 
Lipschitz continuous and satisfies 

Let now x : [0, T] h^ M^ be a solution of (8.1) corresponding to the smooth control u : [0, T] h^ 

M"^. We claim that the map s ^^ x(s) = ( , . ^s ) is a solution to the differential inclusion 

\x{t{s))J 

(8.7). Indeed, setting 

a\s) = ^=^ ^ a"(g) = ^^ ^"(^(^)) a = l,...,m, 

(8.11) 



one has 



fs = («°)'(^) 



^ = f(x{s)) {a^f{s) + E^=i ga{x{s)) a%s)a-{s) + E^/3=i K,(s{''^s)) a-{s)a^{s) . 

(8.12) 
Hence x(-) = (t(-),x(-)) verifies (8.7), because, by (8.11), 

m 

a\s) £[0,1], 5:(a")2(.) = l. 



Q = 
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Notice that the derivatives ti" can now be recovered as 

^"W = tM « = l,...,m. (8.13) 

The following theorem shows that every solution of the differential inclusion (8.7) can be 
approximated by smooth solutions of the original control system (8.1). 

Theorem 8.1 Let x = {x^,x) : [0,5"] ^^ IR}^"^ he a solution to the multivalued Cauchy 
problem (8.7) such that x^{S) = T > 0. Then there exists a sequence of smooth control 
functions u^ : [0, T] h^ M^^ such that the corresponding solutions 

' ^ '^^'^ = {lit) 

of the equations (8.11)-(8.12) converge to the map s h^ x{s) uniformly on [0,5"]. Moreover, 
defining the function x{t) = x{s{t)) as in (8.9), we have 

lim / \x(t) - xJt)\ dt = . (8.14) 

•^~*'^ Jo 

Proof. By the assumption, the extended vector fields 

^"=(/)' ^"^(."J' '-^=(/.l 

are Lipschitz continuous. Consider the set of trajectories of the control system 

^ X = / • (a°)2 + Y.ga a\^ + ^ h,, a^a" , x(0) = ( ^j ) , (8.15) 

a=l Q,/3=l 

where the controls a = {a^, a^, . . . , a™) satisfy the pointwise constraints 

m 

\s)G[0,l], ^(a")2(s) = l sG[0,S]. (8.16) 



- [sj t [U, XJ , 

Q = 



In the above setting, it is well known [2] that the set of trajectories 

s ^ x{s) = {x^, x^,... , x"')(s) 

of (8.15)-(8.16) is dense on the set of solutions to the differential inclusion (8.7). Hence there 
exists a sequence of control functions s ^^ a^is) = {a^, . . . ,a^){s), z^ > 1, such that the 
corresponding solutions s i-^ Xu{s) of (8.15) converge to x{-) uniformly for s G [0,5*]. In 
particular, this implies the convergence of the first components: 

x\{S) = f [al{s)fds -^ x°(5) = T. (8.17) 







We now observe that the "input-output map" a(-) ^^ x{-,a) from controls to trajectories 
is uniformly continuous as a map from L^([0, S"] ; 1R^~^"^) into C([0, 5] ; iR^+"). By slightly 
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modifying the controls a^ in L^, we can replace the sequence a^ by a new sequence of smooth 
control functions d^ : [0, S] ^^ iR^+™ with the following properties: 



7.0 



a.(s) > 



for all s G [0, S"] , zv > 1 . 



(8.18) 



Jo 



r;;0/^M2 



[dl{s)Y ds = T for all 1/ > 1 , 



lim / \d,y(s) — a,y(s)\ ds = 0. 
^^•^ Jo 



This implies the uniform convergence 



Jmi^ \\x{-,du) -^(•)llc([o,S];iRi+") 



(8.19) 
(8.20) 

(8.21) 



By (8.18), for each z^ > 1 the map 



:;0/„m2 



Jo 

is strictly increasing. Therefore it has a smooth inverse s = Si,{t). Recalling (8.13), we 
now define the sequence of smooth control functions Ui^ : [0,T] i-^ iR™ by setting Ui,{t) = 
(ni,...,n™)(t), with 



<{t) 



dr. 



^.22 



/o aO(s,,(r)) 

By construction, the solutions 1 1-^ Xi,{t ; Uy) of the original system (8.1) corresponding to the 
controls Uy coincide with the trajectories 1 1-^ {x\,, . . . , x'^){sy{t)), where Xy = (x|^, x^, . . . , x") 
is the solution of (8.15) with control d^ = (a^, . . . , a™)- 

To prove the last statement in the theorem, define the increasing functions 
t(s)= j [d\r)fdr, U{s) = r [dl{r)f dr , 



and let t i-^ s{t), t h^ Sy{t) be their inverses, respectively. Notice that each Si,{-) is smooth. 
Moreover, 



d_ 
ds 



-t s] 



< 1 



d_ 
ds 



tu{s) 



< 1 



T rS 

lim / \s{t)- Su{t)\dt = lim / \t{s) - U{s)\ds = . 



U^OO Jr. 

Using (8.23), we obtain the estimate 







^.23) 

^.24) 



T 



\x{t) -Xy{t)\dt 







dt + 



Xv{s{t)) - Xv{Sv{t)) 



X{s{t)) - Xu{s{t)) 

/o 

rS rT 

< / \x{s) - x,y{s)\ ds + C ■ \s{t) - Sy{t)\ dt . 
Jo Jo 



dt 



^.25) 
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Here the constant C denotes an upper bound for the derivative w.r.t. s, for example 






C = sup <; |/(x)| + -^ \ga{x)\ + -^ \h^A^)\ } , (8.26) 

i a, 13 

where the supremum is taken over a compact set containing the graphs of ah functions Xi^{-). 
By (8.21) and (8.24), the right hand side of (8.25) vanishes in the hmit ly -^ oo. This completes 
the proof of the theorem. D 

Remark 8.1 For a given time interval [0,T], we are considering controls u{-) in the Sobolev 
space W^''^. The corresponding solutions are absolutely continuous maps, namely they belong 
to W^^'^. Now consider a sequence of control functions u^, whose derivatives are uniformly 
bounded in L^. Assume that the corresponding reparametrized trajectories s ^^ (t^is), x,^{s)), 
constructed as in (8.11)-(8.12), converge to a path s i-^ (i(s), x{s)), providing a solution to 
(8.7). We wish to point out that, in general, the projection on the state space 1 1-^ x{s{t)) may 
well be discontinuous. Notice that, on the contrary, the uniform limit of the controls t >-^ Uu{t) 
must be Holder continuous, because of the uniform L^ bound on the derivatives. 

A completely different situation arises when all the vector fields ha^p vanish identically, so 
that (8.1) reduces to 

m 

x = f{x) + Y,g^{x)u^ (8.27) 

a=l 

Systems of this form have been extensively studied, see [33], [20], [5], [6], or the surveys [24], [3] 
and the references therein. In this case, solutions can be well defined also for general control 
functions u{-) with bounded variation but possibly discontinuous. We recall that, unless the 
Lie brackets [gaidii] vanish identically, one needs to assign a "graph completion" of the control 
u{-) in order to determine uniquely the trajectory. Indeed, at each time r where u has a jump, 
one should also specify a continuous path joining the left state u{t—) with the right state 
u{t+). See [5] for details. 

Remark 8.2 Assume again that system (8.1) reduces to (8.27 ), and consider a sequence 
of Lipschitz controls u^ having equi-bounded derivatives on compact sets and converging 
to a continuous control u uniformly on bounded sets. Moreover, consider initial states x\, 
converging to a point xK Then, the trajectories Xy corresponding to the controls Uy and the 
initial conditions Xy{Q) = xj, converge to the solution x of (8.27 ) corresponding to the control 
u and initial condition x(0) = x% . In particular, if u is constant, the Xy converge to the 
solution of 

X = f{x) x(0) = x" (8.28) 



9 Stabilization 

In this section we examine various concepts of stability for the impulsive system (8.1) and 
relate them to the weak stability of the differential inclusion (8.6)- (8. 7). 

Definition 9.1 We say that the control system (8.1) is stabilizable at the point x G iR" if, 
for every e > there exists (5 > such that the following holds. For every initial state x* with 
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\x^ — x\ < 5 there exists a smooth control function t h^ u{t) = [u^ , . . . ,u'^){t) such that the 
corresponding trajectory of (8.1)-(8.2) satisfies 

\x{t,u)-x\<e forallt>0. (9.1) 

Any such control will be called a stabilizing control 

We say that the system (8.1) is asymptotically stabilizable at the point x if a control u{-) can 
be found such that, in addition to (9.1), there holds 

lim x(t, u) = X . (9-2) 

t— »oo 

Any such control will be called an asymptotically stabilizing control. 

Remark 9.1 Notice that the point x needs not to be an equilibrium point for the vector 
field /. 

Remark 9.2 We require here that the stabilizing controls be smooth. As it will become 
apparent in the sequel, this is hardly a restriction. Indeed, in all cases under consideration, 
if a stabilizing control u G W^'''^ is found, by approximation one one can construct a smooth 
control u which is still stabilizing. 

Remark 9.3 In the above definitions we are not putting any constraint on the control func- 
tion u : [0, oo[i-^ ]RJ^. In principle, one may well have \u{t)\ ^ oo as t — > oo. If one wishes to 
stabilize the system (8.1) and at the same time keep the control values within a small neigh- 
borhood of a given value n, it suffices to consider the stabilization problem for an augmented 
system, adding the variables x""*"^, . . . , x"^™ together with the equations 

x"+" = «" a = l,...,m. 

Similar stability concepts can be also defined for the differential inclusion 

X e F{x) , (9.3) 

see for example [29]. We recall that a trajectory of (9.3) is an absolutely continuous function 
1 1-^ x{t) which satisfies the differential inclusion at a.e. time t. 

Definition 5.2. The point x is weakly stable for the differential inclusion (9.3) if, for every 
e > there exists (5 > such that the following holds. For every initial state x" with |x^— x| < 5 
there exists a trajectory x(-) of (9.3) such that 

x(0) = X* , |x(t) -x\<£ for ah t > . (9.4) 

Moreover, x is weakly asymptotically stable if, there exists a trajectory which, in addition to 
(9.4), satisfies 

lim x(t) = X . (9.5) 
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In connection with the multifunction F defined at (8.6), we consider a second multifunction 
F^ obtained by projecting the sets F{x) C JR^^"" into the subspace JR". More precisely, we 
set 

{mm m 

/(x)(aO)2 + ^g,(x)aV+ Y. haA^)a"a^; u;° G [0, 1] , ^(^")2 = 1 
a=l a,/3=l a=0 

(9.6) 
Observe that, if the vector fields f,ga , and ha,/3 are Lipschitz continuous, then the multifunc- 
tion F^ is Lipschitz continuous with compact, convex values. Our first result in this section 
is: 

Theorem 9.1 The impulsive system (8.1) is asym,ptotically stahilizahle at the point x if and 
only if X is weakly asymptotically stable for the projected graph differential inclusion 

■^x{s)eF^{x{s)). (9.7) 

Proof. Let x be weakly asymptotically stable for (9.7). Without loss of generality, we can 
assume x = 0. 

Given e > 0, choose 6 > such that, if Ix'*! < 6, then there exists a trajectory t h^ x(s) of 
the differential inclusion (9.7) such that x(0) = x", \x{s)\ < e/2 for all t > and x(s) -^ 
as t — > oo. Using the basic approximation property stated in Theorem 8.1, we will construct 
a smooth control 1 1-^ u{t) = {u^, . . . , u™)(t) such that the corresponding trajectory x{-; u) of 
(8.1)-(8.2) satisfies 

\x{t)\ <e for all t > , lim x{t) = . (9.8) 

i— >oo 

Define the decreasing sequence of positive numbers e^ = e2~ . For each A; > 0, choose 6k > 
so that, whenever \x^ < 5k, there exists a solution to (9.7) with 

x(0)=x'', limx(s) = 0, \x(s)\<^ for ah s > . (9.9) 

Choose a sequence of strictly positive integers /c(l) < k{2) < • • •, such that 



lim k{j) = oo , V dktj) = oo . (9.10) 

Note that the second condition in (9.10) is certainly satisfied if the numbers k{j) grow at a 
sufficiently slow rate. 

Assume |x''| < Sq. A smooth control u steering the system (8.1) from x" asymptotically toward 
the origin will be constructed by induction on j. For j = 1, let x : [0, si] h^ M^ be a trajectory 
of the differential inclusion (9.7) such that 

x(0)=x», k(si)|<-^, |x(s)| < ^ for ah s G [0, Si] . 

By the definition of F^ , there exists a trajectory of the differential inclusion (8.7) having the 
form s h^ x(s) = (x'^(s), x{s)). Notice that, in order to apply Theorem 8.1 and approximate 
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x(-) with a smooth solution of the control system (8.1) we would need x^{si) > 0. This 
is not yet guaranteed by the above construction. To take care of this problem, we define 
s'l = si + (5fc(i)/3C, where C provides a local upper bound for the magnitude of the vector field 
/, as in (8.26). We then prolong the trajectory x(-) to the larger interval [0, s'l], by setting 

d fx^{s)\ f I \ 1 ,1 

d:s[xis)) = [m) ^^]^-^^]- 

This construction achieves the inequalities 

x°(4)>«'i-«i>|g^, W^'i)l<^5fc(i)- 

Set T^ = x^{si). By Theorem 8.1, there exists a smooth control u : [0, r^] ^^ iR™ such that the 
corresponding solution s i-^ {x^{s,u),x{s,u)) of (8.11)-(8.12) differs from the above trajectory 
by less than 5^(1) /<i, namely 

|x°(s,n)-x°(s)| <^, \x{s;u)-x{s)\<^ for all s G [0, s'J . 

In particular, setting x{t^u) = x{s{t)^u) as in (8.9), this implies 

|x(ri,u)| < 4(1) , \xit,u)\ < -^ + —^ <£o for ah t € [0, Ti] . 

The construction now proceeds by induction on j. Assume that a smooth control u(-) has 
been constructed on the time interval [0,rj], in such a way that 

\x{tj,u)\ < 5k(j) , \x{t,u)\ < Ekij-i) for all t G [r,-_i, r,-] . (9.11) 

By assumptions, there exists a trajectory s ^^ x{s) of the differential inclusion (9.7) such that 

x(0) = x{tj,u) , \xisj)\ < -^^ , \xis)\ < ^ for all s G [0,Sj] . 

(9.12) 
This trajectory is extended to the slightly larger interval [0, s'], with s'- = Sj + 5k{j)/^C, by 
setting 

Notice that, by (9.12), (9.13), and (8.26), we have 

x\s'^) > 4 -sj>^-^, |x(4)| < ^4o+i) • (9.14) 

Set Tj+i = Tj + x°(s'). Using again Theorem 8.1, we can extend the control u : [0,Tj] h^ M^ 
to a continuous, piecewise smooth control defined on the larger interval [0, tj+i], such that the 
corresponding solution s i-^ x{s,u) of (8.1)-(8.2) satisfies 

\x{tj+i,u)\ < 4(j+i) , \x{t,u)\ < EkQ) for ah t £ [tj, Tj+i] . (9.15) 

Notice that, at this stage, the control n is obtained by piecing together two smooth control 
functions, defined on the intervals [0,tj] and [Tj-,rj+i] respectively. This makes u continuous 
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but possibly not C^ in a neighborhood of the point Tj. To fix this problem, we slightly modify 
the values of u in a small neighborhood of Tj, so that u becomes smooth also at this point, 
while the strict inequalities (9.15) still hold. 

Having completed the inductive steps for all j > 1 we observe that 

iim Tj = > — ^ = oo 

3 

because of (9.10). As t ^ cx), by (9.15) we have x{t,u) -^ 0. This shows that the impulsive 
system (8.1) is asymptotically stabilizable at the origin, proving one of the implications stated 
in the theorem. 

The converse implication is obvious, because every solution of the system (8.1) corresponding 
to a smooth control yields a solution to the differential inclusion (9.7), after a suitable time 
rescaling. 

Corollary 9.1 Let a point x be weakly asymptotically stable for the differential inclusion 
(8.4)- Then the system (8.1) is asymptotically stabilizable at x. 

Proof. Since the point x is weakly asymptotically stable for (8.4), then it is asymptotically 
stable for the differential inclusion (9.7), which, in turn, implies that the impulsive system 
(8.1) can be stabilized at x. 



9.1 Lyapunov functions 

There is an extensive literature, in the context of O.D.E's and of control systems or differential 
inclusions, relating the stability of an equilibrium state to the existence of a Lyapunov function. 
We recall below the basic definition, in a form suitable for our applications. For simplicity, we 
henceforth consider the case x = G iR", which of course is not restrictive. 

Definition 9.2 Let x ^^ G{x) C iR" be a set valued function defined for x £ M"". A scalar 
function V defined on a neighborhood J\f of the origin is a weak Lyapunov function for the 
differential inclusion 

X £ G{x) 

if the following holds. 

(i) V is continuous on J\f , and continuously differ entiable on A/^\{0}. 

(ii) y(0) = while V{x) > for all x / 0, 

(Hi) For each 6 > sufficiently small, the sublevel set {x ; V{x) < 5} is compact. 

(iv) At each x ^ one has 

inf W{x)-y<0. (9.16) 

yeGix) 
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The following theorem relates the stability of the impulsive control system (8.1) to the existence 
of a Lyapunov function for the differential inclusion (8.4). 

Theorem 9.2 Consider the multifunction T defined at (8.5). Assume that the differential 
inclusion (8.4) admits a Lyapunov function V = V{x) defined on a neighborhood N of the 
origin. Then the control system (8.1) can be stabilized at the origin. 

Remark 9.4 We are here requiring that the function V satisfies the conditions (i)-(iii) in 
Definition 9.2, and that for each x ^ there exists z G J^i^) such that 

VV{x)-z<0. (9.17) 

Notice that the multifunction J^ in (8.5) has unbounded values. An equivalent condition, 
formulated in terms of the bounded multifunction F in (8.6) is the following. 

(ii/ ) For every x £ M \ {0}, there exists y = {yo,y) £ F{x) such that 

W{x)-y<0 yo>0. (9.18) 

Notice that the set of conditions (i)-(iii) and (iv') represents a slight strengthening of the 
notion of weak Lyapunov function when this is applied to the projected graph differential 
equation (9.7). Yet, let us point out that the weak stability of (9.7) is not enough to guarantee 
the bility of the control system (8.1), so the condition yo > in (9.18) plays a crucial role. 
Indeed, on M^, consider the constant vector fields / = (1,0), hu = (0,1), /i22 = (0,-1), 
9i = 92 = hi2 = /i2i = (0,0). Then, choosing a^ = 0, a^ = a"^ = l/\/2 we see that 
(0,0,0) G F{x) for every x G ]R^. Hence condition 

inf VV -y <0 

yeF{x) 

is trivially satisfied by any function V. However, it is clear that in this case the system (8.1) 
is not stabilizable at the origin. 

Remark 9.5 Theorem 9.2 is somewhat weaker than its counterpart, Theorem 9.1, dealing 
with asymptotic stability. Indeed, to prove that the impulsive control system (8.1) is stabi- 
lizable, we need to assume not only that the differential inclusion (9.7) is weakly stable, but 
also that there exists a Lyapunov function. 

Proof of Theorem 9.2. Given e > 0, choose 6 > such that 

V{x) < 25 implies |x| < e. 
Let an initial state x' be given, with V{x^) < 5. 

According to Remark 9.4, for every x ^ there exists {yo,y) G F{x) such that (9.18) holds. 
We recall that the multifunction F in (8.6) is Lipschitz continuous, with compact, convex 
values. Since the set i7 = {x ; S < V{x) < 35} is compact, by the continuity of W we can 
find K > such that, for every x G $7, there exists y = {yo, y) G F{x) with 

VV{x) ■y<0, yo>K. 
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The control u will be defined inductively on a sequence of the time intervals [tj-i, Tj], with 
Tj > JK. Set To = 0. Consider the differential inclusion 

^ j F{xis))n{iyo,y); VVix)-y<0, yo > '^l if 5<V{x)<26, 

ds^'\F{xis)) if V{x)<6 or V{x)>25, ^ ' 

with initial data x(0) = (0,x^). The right- hand side of (9.19) is an upper semicontinuous 
multifunction, with nonempty compact convex values. Therefore (see for example [2]), the 
Cauchy problem admits at least one solution s h^ x{s) = {x^{s),x{s)), defined for s £ [0, 1]. 
We observe that this solution satisfies 

x°(l) > K , V{x{s)) < S for all s £ [0, 1] . 

Hence, by Theorem 8.1 there exists a smooth control u : [0, ri] i-^ IR"\ with ti = x^{l) > k, 
such that the corresponding trajectory of (8.1)-8.2) satisfies 

V{x{t, u)) < |,5 = 2(5 - 2-^5 for all t G [0, n] . 

By induction, assume now that a smooth control u{-) has been constructed on the interval 
[0, Tj] with Tj > Kj, and that the corresponding trajectory 1 1-^ x{t, u) of the impulsive system 
(8.1)-(8.2) satisfies 

V{x{t, u)) <2S- 2~^ t e [0, Tj] . (9.20) 

We then construct a solution s i-^ x{s) = {x^{s), x{s)) of the differential inclusion (9.19) for 
s G [0, 1], with initial data x(0) = (0, x{tj, u)). This function will satisfy 

x°(l) > K , V{x{s)) <26- 2-H for all s G [0, 1] . 

Using again Theorem 8.1, we can prolong the control u to a larger time interval [0, Tj+i], with 
Tj-i-i — Tj = x''(l) > K, in such a way that 

V(x{t, u)) <26- 2-^-^6 t G [0, Tj+i] . (9.21) 

At a first stage, this control u will be piecewise smooth, continuous but not C^ in a neighbor- 
hood of the point Tj. By a local approximation, we can slightly change its values in a small 
neighborhood of the point Tj, making it smooth also at the point Tj, and preserving the strict 
inequalities (9.21). 

Since Tj > kj for all j > 1, as j ^ oo the induction procedure generates a smooth control 
function n(-), defined for all t > 0, whose corresponding trajectory satisfies V{x{t,u)) < 26 
for all t > 0. This completes the proof of the theorem. D 



10 A selection technique 

In the previous section we proved two general results, relating the stability of the control 
system (8.1) to the weak stability of the differential inclusion (8.4). A complete description 
of the sets J-'{x) in (8.5) may often be very difficult. However, as shown in [29], to establish 
a stability property it suffices to construct a suitable family of smooth selections. We shall 
briefly describe this approach. 
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Let a point x £ iR" be given, and assume that there exists a C^ selection 

{m m 

a=l o,/3=l 

depending on an additional parameter ^ G IR"^, such that 

/(x)+7(x,e)=0. (10.1) 

for some ^ G M'^. Assuming that 7 is defined on an entire neighborhood of (x, ^), consider the 
Jacobian matrices of partial derivatives computed at {x,$,): 

dx dx ' d^ 

Theorem 10.1 In the above setting, if the linear system with constant coefficients 

x = Ax + Bi (10.2) 

is completely controllable, then the differential inclusion (8.4)-(8.5) is weakly asymptotically 
stable at the point x. 

We recall that the system (10.2) is completely controllable if and only if the matrices A,B 
satisfy satisfy the algebraic relation Rank[i?, AB^ ■ ■ ■ , A^^^B] = n. This guarantees that 
the system can be steered from any initial state to any final state, within any given time 
interval [4, 32]. 

To prove the theorem, consider the control system 

x = f{x)+-f{x,0. (10.3) 

By a classical result in control theory, the above assumptions imply that, for every point x" 
sufficiently close to x, there exists a trajectory starting from x" reaching x in finite time. In 
particular, in view of (10.1), the system (10.3) is asymptotically stabilizable at the point x. 
Since all trajectories of (10.3) are also trajectories of the differential inclusion (8.4), the result 

follows. n 

Remark 10.1 Toward the construction of smooth selections from the multifunction J^ we 
observe that each closed convex set J^{x) can be equivalently written as 

{m m 

Y^g^{x)w^+ Y. h^Ax)w^wf'- {w\...M-)&]R"^ 
a=l a,l3=l 

( m ] (10.4) 

+C0I J2 KMx)w"w^; {w\...,w"')£]R"' 

[a,l3=l 
= f{x)+J'l{x)+J^2(.x). 

Indeed, by definition we have J^{x) = f{x) + J-'i{x). To establish the identity (10.4) it thus 
suffices to prove that 

^1 + ^2 ^ .Fi . (10.5) 
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Since the set J-i{x) is convex and contains the origin, for every (w^ , . . . , w"^) £ iR™ and 
£ G [0, 1] we have 

(m a m a 3\ 
2^ 9a{x) —r+ 2^ ha,l3{x) G > 1 . 

Letting e ^ we find 

m 

lim y, = ^ /i„,^(x)^"u;^. (10.6) 

^^ a,/3=l 

Since .Fi(a;) is closed, it must contain the right hand side of (10.6). This proves the inclusion 
•^2 ^ -^i- Next, observing that J^2 is a cone, for every y2 G J-2 and e > we have £^^y2 G 
J^2 ^ -^i- Therefore, if yi G J^i we can write 

yi + 2/2 = lim (1 - e)yi + e(e~^y2) G J^i 
because .7-"i is closed and convex. This proves (10.5). 

By Theorem 10.1 and the above remark, one may establish a stability result be constructing 
suitable selections 7(a;,^) G J-'2{x) from the cone J^2- 



Part III 

Stabilization of mechanical systems 

In this part we address the question of how to use some time-dependent holonomic constraints 
as controls in order to stabilize a mechanical system to a given state. 

11 Stabilization with vibrating controls 

For reader's convenience, we summarize the results in Section 4. Let G = {gr,s)r,s=i,...,N+M be 
the matrix that represents the covariant inertial tensor in a given coordinate chart {q,u). In 
particular, the kinetic energy of the whole system at a state {q, u) with velocity {v, w) G IR ^ 
is given by 

'^ = 29i,j{(l, u)v'v^ + gi^N+a{q, u)v'w°' + -gN+a,N+^{q, u)w°'w'^. 

Here and in the sequel, i,j = 1,...,N while a,(3 = 1,...,M. By G~^ = {g'^'^)r,s=i,...,N+M 
we denote the inverse of G. Moreover, we consider the sub-matrices Gi = (ftj), (G^^)2 = 
lgN+a,N+f3\ g^j^^ {G^^)i2 = (5*'^^"). Finally, we introduce the matrices 



A = [f^^) = (Gi)-^ , E = (e,,^) = {{G-')2r' , K = [e,) = {G-')i2E . (11.1) 

We recall that all the above matrices depend on the variables q, u. Concerning the external 
force, our main assumption will be 
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Hypothesis (A). The force F acting on the whole system does not explicitly depend on time, 
and is affine w.r.t. the time derivative of the control, so that 



F{q,p,u,w) = F^{q,p,u) + F^{q,p,u) ■ w . 



fll.2) 



Taking the component along the manifold Q, this implies 

Fq = Fq{<1,P,u,w) = F^{q,p,u) + FQ{q,p,u) -w 
We can thus write the equations of motion in the form 

( q\ ( Ap \ / K \ /0\ 



p 
\u J 



\ 



■¥%p+n 







+ 



/ 



V 



-^^f + 4 



1m 



u + u 



I 



1 dE 

2 dq 



\ j 



u . 



(11.3) 



Our main goal is to find conditions which imply that the system (11.3) is stabilizable at a 
point (q,0,u). Two results will be described here. The first one relies on suitable smooth 
selections from the corresponding set-valued maps, as in Theorem 10.1. The second one is 
based on the use of Lyapunov functions. 



For each q, u, consider the cone 

J., ^ • — f idE{q,u) 
I (q,u) = co<w' ■ 



dq 



w ; w G M 



M 



(11.4) 



Let ^ G M be an auxiliary control variable, ranging on a neighborhood of a point ^ G M'* 
and consider a control system of the form 

q = Ap, 

P = FQ(.q,P,u)+j{q,p,u,^), 



(11.5) 



where 7 is a suitable selection from the cone T. It will be convenient to write (11.5) in the 
more compact form 

(g,p) =$(g,p,n,^), (11.6) 

regarding {q,p) G iR^+^ as state variables and .^ G M'^ as control variable. Assume that 



F^{q,0,u)+j{q,0,u,^)=0. 



(11.7) 



By (11.5) this implies $(^,0,u,C) = G M^^ . To test the local controllability of (11.5) at the 
equilibrium point (g, 0, u, ^) we look at the linearized system with constant coefficients 



P 



where 



A 



d^ 



^{"\.B,, 






(11.^ 



d{q,p) 
with all partial derivatives being computed at the point (g, 0, n,^). We can now state 
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Theorem 11.1 Assume that a smooth m,ap 

{q,p,u,^) ^ l{q,p,u,i) G T{q,u) 



(11.9) 



can he chosen in such a way that (11.7) holds and so that the linear system (11.8) is completely 
controllable. Then the system (11.3) is asymptotically stabilizable at the point {q,0,u). 

Proof. According to Theorem 10.1 and Remark 10.1, it suffices to show that the control 
system 



/9\ / 

p 



\u J 



V 



Ap 



'2P l)^P + ^Q 







+ 



/ 



K 



-P W^^Q 



V 



1 



M 



\ 



J 



w + w 



( \ 



IdE 



V ) 



( 



w + 








\ 



(11.10) 
is locaUy controUable at {q,0,u). Notice that in (11.10) the state variables are q,p,u, while 
w, ^ are the controls. Computing the Jacobian matrices of partial derivatives at the point 
{q,p, u; w, ^) = {q, 0, u, 0, S,), we obtain a linear system with constant coefficients, of the form 



P 

u 



An 

A21 A22 A23 





B12 

p l + l B21 B22 

u I \ 1m 




A I P l+(6i 132 

u 



w 
fll.U) 



By assumption, the linear system (11.8) is completely controllable. Therefore 



Rank B, AB, ... , A^^-^B 
We now observe that the matrices A,B at (11.8) correspond to the submatrices 

V A21 A22 J 

Hence from (11.12) it follows 



2N. 




B21 



(11.12) 



(11.13) 



span 



Bi, ABi, 



A 



2N-1 



Bi 




q G M^, peM^ 



(11.14) 



Adding to this subspace the subspace generated by the columns of the matrix B2, we obtain 
the entire space M ~^ . We thus conclude that the linear system (11.11) is completely con- 
trollable. In turn, this implies that the nonlinear system (11.10) is asymptotically stabilizable 
at {q,0,u), completing the proof D 



By choosing a special kind of selection and relying of the particular structure of (11.5), we 
can deduce Corollaryll.l below. To state it, if fc is a positive integer such that kM > N and 
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W = {wi, . . . ,Wk) G M^^'', let us consider the N x kM matrix 



M{u,q,W) = 















(11.15) 



Corollary 11.1 Let k he a positive integer and assume that for a given state {q, u) there exists 
a k-tuple W = (ttJi, . . . , Wk) G {R^)^ such that 



Rank(M(n,g,VF) 



AT 



and 



{^y) + Z^a,/3=l ^^ Z^r=l Wj.Wj. — U 



(11.16) 



(11.17) 



where the involved functions are computed at {q,p,u) = {q,0,u). Then the system (11.3) is 
asymptotically stabilizable at the point (q, 0, u) . 



Proof. Let us observe that the matrices A and B in (11.13) have the fohowing form: 



B 



A 






dq dp 



^11.18) 



so that, in particular, 



/ A-^ 



KB 



i9(F+7) 97 

dp ' as, 



^11.19) 



Let us set d = kM, ^ = W = {wi, . . . ,Wk), and 



-Wji w^ 



i = l,...,N 



2^tt dt 

Notice that, by 2-homogeneity 7 = (7^, . . . ,7^), is in fact a selection of the set- valued map 
r defined in (11.4). In view of Theorem 11.1, to prove the asymptotic stability it is sufficient 
find 

such (11.17) holds and, moreover. 

Rank [B, AB] {q, 0, u, W) = 2N. 
Since ^ is a non-singular matrix, by (11.19) the latter condition is equivalent to 



R&nk(^-^yq,0,u,W) = N. 
In turn, this coincides with (11.16), so the proof is concluded. 



(11.20) 
D 
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We now describe a second approach, based on the construction of a Lyapunov function. 
Throughout the fohowing we assume that the external force F in (11.2) admits the repre- 
sentation 

dU 

F = F{q,p,u,w) = + F\q,p,u) -w. (11.21) 

d{q,u) 

in terms of a potential function U = U{q, u). 

Definition 11.1 Given a k-tuple of vectors W = {vui, . . . ,Wk} C iR^, the corresponding 
asymptotic effective potential {q,u) i-^ UwiQ,u) is defined as 

1 ^ 
Uw{q, u) = U{q, u)- -Y^ w\E{q, u)we 

k M 



{ = U{q,u)- -J2 Yl eaA<l^^)wf 



e=la,l3=l 



Theorem 11.2 . Let the external force F have the form (11.21). For a given state {q,u), 
assume that there exist a neighborhood J\f of {q,u) and a k-tuple W = {wi, . . . ,Wk} C M^ , 
as in Definition 11.1 which, in addition, satisfy the following property: 

• There exists a continuously differentiahle map u ^^ /3('u) defined on a neighborhood of u 
such that the function 

{q,u) ^ Uw{q,u) + /3{u) 

has a strict local minimum at {q,u) = {q,u). 
Then the system (11.3) is stabilizable at {q,0,u). 

Proof. As in Section 10, consider the symmetrized differential inclusion corresponding to 
(11.3), namely 

p]^-oli-b4'p-'^] + -^'[^h I-' weM^y (11.22) 

To prove the theorem, it suffices to show that the point {q, 0, u) is a stable equilibrium for the 
differential equation 

q\ f Ap \ 

P \ = \ -¥'^P-'-^ ■ (11-23) 

Indeed, by the definition of Uw, the right hand side of (11.23) is a selection of the right 
hand-side of (11.22). Introducing the Hamiltonian function 

Hw = -jpAp'^ + Uw, 
the equation (11.23) can be written in the following Hamiltonian form: 

. . xt (dHw dHw „\ ,.^^., 

q,P,u) =[-^, -^^, Oj. (11.24) 
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Therefore the map 



V{q,p,u) = Hwiq,P,u) + (3{u) 



^11.25) 



is a Lyapunov function for (11.23), from which it fohows that {q,0,z) is a stable equihbrium 
for (11.23). D 



12 Examples 






Figure 3: A pendulum whose pivot oscillates vertically (on the left) and horizontally (center). 
On the right: a bead sliding without friction along a rotating axis. 

Example 1 (pendulum w^ith oscillating pivot). Let us consider a pendulum with fixed 
length r = 1, whose pivot is moving on the vertical y-axis, as shown in Figure 3, left. Its 
position is described by two variables: the clockwise angle 9 formed by the pendulum with 
the y-axis, and the height h of the pivot. We now consider h = u{t) to be our control variable, 
while the evolution of the other variable 9 = q{t) will be determined by the equations of 
motion. We assume that the control function t ^^ u{t) can be assigned as a function of time, 
ranging over a neighborhood of the origin. We assume that the both the pendulum and its 
pivot have unit mass, so that the kinetic matrix G and the matrices in (11.1) take the form 



G 



1 



smq 




A 



E 



[l + cos^ 



K 



sin( 



Remark 12.1 To be consistent with the general theory we need to put a mass on the pivot 
as well. This is needed in order that the matrix G be invertible. On the other hand it is 
easy to show that the resulting control equations are independent of the mass of the pivot. 
Actually this should expected, since the motion of the pivot is here considered as a control. Of 
course, what is not independent of the mass of the pivot is the constraint reaction necessary 
to produce a given motion of u. 

Notice that orthogonal curvature of the constraint foliation A -i.e. the coefficient of (tt)^, see 
Section 6 — is different from zero, for ^ = — 2 sing cos g. 

In the presence of downward gravitational acceleration </, the control equations for q and the 
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corresponding momentum p is given by 

q = p + {su\q)u 

(12.1) 
P = —^ — p{cos q)u — [sm q) [cos q)u'^ , 

where U{q,u) = gcosq is the gravitational potential. 

Using Theorem 11.2, it is easy to check that this system is stabilizable at the upward equi- 
librium point {q,p,u) = (0,0,0). Indeed, choosing W = {w} with w > g, the corresponding 
effective potential 

Uw = 9 cosq — -(1 + cos q)w . 

has a strict local minimum at q = 0. 

To illustrate an application of Theorem 11.1, we now show that the above system is asymp- 
totically stabilizable at every position (g, 0,0) with < |g| < tt/2. To fix the ideas, assume 
q > 0, the other case being entirely similar. For ^ > 0, the map "y{q,p,$.) = —^ provides a 
smooth selection from the cone 

Tiq,u) =w!^^^^w'; weM^={-C; ? > 0}. 
The corresponding system (11.5), with ^ as control variable, now takes the form 

{' = ' ■ , (12.2) 

[ p = g sm q — q ■ 

It is easy to check that {q,p, S,) = {q, 0, g sing) is an equilibrium position and the system is lo- 
cally controllable at this point. Indeed, the linearized control system with constant coefficients 

\p) \ -gcosq OJypJ V-1/ 
By Theorem 11.1, the system (12.1) is asymptotically stabilizable at (g, 0,0). 

By similar arguments one can show that, by means of horizontal oscillations of the pivot, one 
can stabilize the system at any position of the form (q, 0, 0), with ^ < |g| < tt. 

Example 2 (sliding bead). Consider the mechanical system represented in Figure 3 (right), 
consisting of a bead sliding without friction along a bar, and subject to gravity. The bar can 
be rotated around the origin, in a vertical plane. Calling q the distance of the bead from 
the origin, while u is the angle formed by the bar with the vertical line. Regarding u as the 
controlled variable, in this case the kinetic matrix G and the matrices in (11.1) take the form 

G=(l ^? V A={1), E={q'), K={0). 

The orthogonal curvature of the constraint foliation A is not vanishing identically: indeed, 
one has ^ = 2q. The control equations for q and the corresponding momentum p are 

{' = ''' .2 (12.3) 

I p = — g cos u + qu. 
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This case is more intuitive than the previous ones. Indeed, it is clear that a rapid oscillation 
of the angle u generates a centrifugal force that can contrast the gravitational force. More 
precisely, the system can be asymptotically stabilized at each {q,p,u) G ]0, +oo[ x{0}x ] — 
7r/2,7r/2[. A simple proof of this fact follows from Theorem 11.1. Indeed, for g > we 
trivially have T{q,u) = {qw'^ ; w £ M} = {^ £ M; ^ > 0}. It is now clear that, if cosn > 0, 
then the control system 

f Q = P, 

\ P = ~9 cosu + S, , 

admits the equilibrium point (^,0,.^), with S, = g cosu > 0. Moreover, this system is com- 
pletely controllable around this equilibrium point, using with controls ^ > 0. An application 
of Theorem 11.1 yields the asymptotic stability property. 

We remark that the stabilizing controls cannot cannot be independent of the position q and 
the velocity p. In particular, the approach in Theorem 11.2, based on effective potential, 
cannot be pursued in this case, because a constant control w cannot stabilize the system 



P, 



P 



-g cosu + qw 



Example 3 (double pendulum w^ith moving pivot). So far we have considered examples 
with scalar controls. We wish now to study a case where the control u is two-dimensional, 
hence the cone (11-4) is also two-dimensional. Consider a double pendulum consisting of 
three point masses Po,Pi,P2, such that the distances |PoA|, IA-P2I are fixed, say both equal 
to 1. Let these points be subject to the gravitational force and constrained without friction 
on a vertical plane. Let {u^,u'^) be the cartesian coordinates of the pivot Pq , and let q^,q^ 
the clockwise angles formed by PqPi and -P1-P2 with the upper vertical half lines centered in 
P^ and P^, respectively, see Figure 4. Because of the constraints, the state of the system 
{Po,Pi,P2} is thus entirely described by the four coordinates (q^ , q'^ , u^ , u'^) . The reduced 
system, obtained by regarding the parameters {u^,u'^) as controls and the coordinates {q^,q^) 
as state-coordinates, is two-dimensional. We assume that the all three points have unit mass, 
so that the matrix G = {grs) representing the kinetic energy is given by 



/ 



G 



cos{q^ — q^) 2cosg^ — 2sing^ \ 



cos(g'^ — q^ 
2 cos q^ 



cosq 



\ —2 sin (7^ —sin (7^ 

Moreover, recalling (11.1), we have 

/ -. 4(sing-'-) ^ 



cosq 
3 




sm q 




E 



V 



3+cos3(g^— q-^) 

2sm2(7l 
— 3+cos3(g-'-— (jr*^) 



2sin2g^ 

4(singi)2 
~ -3+cos3((ji-(j^) / 



iF^)'=2gsmq\ {F^f = gsmq^ 
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Figure 4: Controlling the double pendulum by moving the pivot at Pq . 

Let us observe, as in Remark 12.1, that the matrix E and the corresponding control equations 
are independent of the pivot's mass. 

Proposition 12.1 For every q^ g]0, 7r/4[ (resp. q^ g] — 7r/4, 0[) there exists 5 > such that 
for all (f g] — (5, 0[ {resp. q^ g] — 5, 0[) the system is stabilizable at {q^ , q'^ , p^ , p"^ , u^ , u^) = 
{q\f, 0,0,0,0). 
Moreover, the system is stabilizable at {q^ ,q^ ,p^ ,p'^ ,v^ ,u^) = (0,0,0,0,0,0). 



Remark 12.2 For obvious reasons of translational invariance, if we replace {ui,U2) = (0,0) 
with any other value {v}-,vP') G IP? the result holds true as well. 

Proof of Proposition 12.1. Using Corollary 11.1 with N = M = 2 and k = I, we have that 
the system can be stabilized to {q^ , q"^ , u^ , u'^) provided there exist w G M^ such that 



and 



gsmf +J:l,f3=i^w"w^ = 



/ 9ei,i -1 I 961,2 -2 9e2,i -1 , 962,2 -2 \ 



(12.4) 



det 



IkF 



dq^ 



dq^ 



dq^ 



de\A -1 . 9ei 2 -2 9e2 i -1 , 962 2 -2 



/o 



Notice that the latter relation can be written as 
where the matrix Q = ( Qa^p ] is defined by 

ae / -\\ 

dq^ 



1 



dE 
dq^ 



(12.5) 



(12.6) 



(12.7) 



We recall that E denotes the matrix {ea,p). Moreover, it is meant that the functions in 
(12.4)-(12.7) are computed at {q^,f). 

Let us fix q^ g]0, 7r/4[. In order to establish the existence of a 5 > such that for every 
(f' g] — 5, 0[ there is a u) verifying the relations (12. 4), (12. 5), we need to study the intersections 
of the level sets of the quadratic forms Q, 4-t, ot- 
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Let us write the matrix 4^- and 4^ explicitly: 

8suiq'^(-3cosq^+cos{q^-2q'^)] 
(^-3+cos(2(gi-g2))) 

4f -3cos2gi+cos2<j2 j 
(-3+cos{2{q^-q-^))j 

I 8sm2g^sin(2(g^-g2)) 



dE 



a\ -3cos2ij^+cos2g' 
(-3+cos(2(gl-Q2))y 

8cosg^ ( 3sing^+sin(g-'^— 2g'^) 1 
(-3+cos(2(gi-g2))) 



9E 



4 sin 



v 



3+cos(2(gi-g2))j 

4sin2g^sin(2(g^-<?2)) 

f-3+cos(2(gl-g2))j r-3+cos(2(gl-g2)) j 



in2glsin(2(gl-g2)) \ 
3+cos(2{gi-g2))j 

8cos2gisin(2(g^-g2)) 



In particular, one has 



16 



(-3 + cos(2(gi -g2)) 



<0. 



dE 



det ( ^(gSg^; 



for all q^ ^q^ ■ 
Hence, one has: 

(i) The quadratic form w i-^ w'^ i-^w is indefinite, so it can be factorized by two linear, 
independent, forms. Let us assume that, (f g] — ^^,0[, so that, in particular, T'l < 0. 
Hence, for suitable functions a = a{q^,q'^), b = b{q^,q'^) such that a{q^,q'^) / b{q^,q'^) 
for all q^ ,q^ , one has 

^^a,/3 a a ^62,2. 2 1\/ 2 ;, 1\ 

-j-w wp = (w — aw )(w — bw ). 



dq^ 



dq^ 



(ii) If q^ g] — q^, 0[, the quadratic form w ^^ w^ 4-^w is positive semi-definite. Hence it can 



9g2 

be factorized by the positive scalar function -^r- and the square of a linear function. 
Moreover this linear function coincides with one of the two linear factors of the quadratic 
form w 1-^ tf^^-rt/;. This is a trivial consequence of the identity 

/9ei,2 5e2,2\^ „c^e2,i 9e2,2 9ei,2 9e2,2 c^e2,2 dei^i de2,2 f de2,2^ '^ 
\ dq^ dq^ J dq^ dq^ dq^ dq^ dq^ dq^ dq^ \ dq^ 

which can be verified by direct computation. Let {w^ — aw^) be the common factor of 
the two quadratic forms. Hence, we obtain 



9e, 



a,/3 a a 



de 



dq^ 



w W 



2,2 / 2 



1\2 



9g2 



[w — aw ) 



(iii) The quadratic form w ^^ w'Qw is semi-definite and, at each {q ,q ), it is proportional 



to the form w^ 4-^w. More precisely, one has 



dq 



Qa,f3w"w' 



^,nl^ 



962,2 a-b\ dea,i3 „ „ 
^w wp 



dq 



dq^ 



5e2,2 9e2,2 a-b 



iw^-aw'?. 
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This is easily deduced by (12.7). Notice, in particular, the form Qa,/3w"w^ is never equal 
to the null form, since a{q^, q^) ^ b{q^, q^) for all g-*^, q^. 

If S* is a 2 X 2 matrix and /? G iR let us set 

{w^ Sw = p} = {w ^ IE? I w^ Sw = p}. 

Since w"^ ^w is positive definite and sing^ < 0, there exists a real number ry > such that 

{a p 
tt;T— -^ty = — sin (fv > = {w ^ M^ : {tiP' — aw^) = r/} U {tf G IR^ : {vo^ — aw^) = — ??}, 

so that, in particular, 

tf^— "2^ = -gs\nq^\ n {w e Si^ : {w^ - anP) = 0} = 0. 

By (iii) this implies 

[w^^^w = -c/sing^} n {w^Qw = 0} = 0. (12.8) 

Moreover, by (i) the line {w G Fl? : {w'^ — aw^) = 0} is asymptotic to the hyperbolic arc 

.dE 
dq^ 



^w'—jw = -2gsmq |, 



which implies 

Iw^—jW = -2gs'mq^\ n {w^ -^-^w = -srsing^j / . (12.9) 

Putting (12.8) and (12.9) together, we obtain the first statement of the theorem. 

On the other hand, the second statement will be proved by an application of Theorem 11.2. 
Since U{q) = g{2 cos g^+cos q^) is a potential, by letting VF = {(0, ry)} and /3(u) = (n^)^ + (u^)^, 
we have that the effective potential 

Uw{q, u) = U{q) + 7fe2,2{q) + P{u) 

has a strict minimum at {q,u) = (0,0,0,0) as soon as \ri\ is large enough. In view of 
Theorem 11.2, this implies the that the system is stabilizable at {q^,q'^,pi,p2,u^,u^) = 
(0,0,0,0,0,0). 

n 
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